https://platform.openai.com/playground/p/OLOQPOJQhQBSfWFnqzldndF0?model=gpt-3.5-turbo&mode=chat
My prompt for the chatbot was ‘You are a graduate recruitment consultant. You help graduate students prepare for interviews for a job in investment banking.
Use the information available online to provide step-by-step instructions on performing well in investment banking interviews.’
For my first question about what questions to prepare for an interview at Bank of America’s Mergers and Acquisitions department, I set the temperature to 0.82 and let the p remain at 1. I kept the number of tokens at 162 to see whether the chatbot would jump directly to the questions that were asked in the interview and keep the content concise. However, I noticed two irrelevant points in the bot’s response: the bot started with a generic suggestion on how to prepare for an interview for BofA’s M&A department; the bot also provided suggestions after each question on how to tackle them. I did not want either of these statements in the bot’s response.
What I did next, was to add the phrase ‘be concise and only answer the question’ to my prompt. I asked another question about how long it usually takes to prepare well for an interview for the position of leveraged finance analyst. This time I increased the temperature to 1.2 while reducing the top p to 0.8, and reduced the tokens to 150, with the intention that the bot will provide the most relevant and concise answer to the question. This time, the bot directly addressed the question at the start, however, it then continued to provide suggestions on how to prepare for the interview after the first paragraph. What I wanted was addressed in the first paragraph, but I presume the bot exhausts the tokens based on the limit that we set.
For my last question, I removed the step-by-step instructions phrase from my prompt as I thought that was causing the bot to include irrelevant content in the response. I kept the token limit and top p at 150 and 0.8 respectively (again to encourage the bot to be precise), and reduced the temperature to 1. I asked what are some common questions asked in an interview for the role of structured finance analyst. However, the bot went back to the same approach as the first question, providing a generic statement on how to prepare for interviews in structured finance, as well as providing answers to the questions asked in the interview.