Category: Weekly Class Assignments

Welcome to the enhanced Business Chat 5.0!

Business Chat 4.0 served as a chatbot consultant, providing entrepreneurs with insights and guidance for their business inquiries. However, it offered surface-level, clear responses. After undergoing fine-tuning using the gpt-llm-trainer v2, Business Chat 5.0 has emerged as a more precise and concise business chat assistant for entrepreneurs.

Fine-Tuning Process

The fine-tuning process, though initially tricky, was successfully navigated, resulting in an improved and more effective version.

I used this notebook for fine-tuning and encountered several issues that took me over three hours spread across two days to resolve:

1. Error/failure message on step two on that were resolved by simply re-running the cell. A classmate helped me resolve this issue Tuesday night.
2. Several step three errors. The initial step three error indicated that I exceeded my TPM tokens per minute. Initially, I thought this was due to insufficient funds in my account to buy tokens, so I added funds. However, this did not resolve the issue.
3. I began considering all elements that could be driving token usage.
4. Recalling from class that the notebook was set to 50 examples but the homework only asked for 30 examples, I adjusted the notebook to 30, but the same error persisted.
5. I then shortened my prompt from a lengthy business consultant description to simply “Answer entrepreneur questions.” Despite multiple iterations, reducing the prompt length increased the run time of step three, but it still failed.
6. It wasn’t until I noticed that step three was running with model=”gpt-4.0″ that I changed it to model=”gpt-3.5-turbo” and later to model=”gpt-3.5-turbo-16k“. Finally, step 3 worked!
7. The other steps functioned without issue, and I eventually achieved a successful fine-tune run in Playground. I did not add more data after this stepped worked.

Business Chat 4.0 is a chatbot consultant offering entrepreneurs insights and guidance for their business inquiries, assisting in decision-making throughout their entrepreneurial endeavors. Additionally, the chatbot can generate preliminary business plans upon request, particularly beneficial for entrepreneurs seeking funding from potential investors. Ask Business Chat 4.0 a question!

Temperature and Top P Settings

In crafting my chatbot, I experimented with Temperature and Top P settings.

Decision:

• I settled on a temperature setting of 1 to strike a balance between coherence and creativity in the chatbot responses. I felt the flow was more natural flow while maintaining logical structures. I chose the top p setting of 1 because it emphasizes precision and relevance. This approach seemed most fitting for a business chatbot based on some research I did.  

Analysis:

• Higher temperature settings (1.5) generate longer and more detailed responses with richer content.
• Higher “Top P” settings (1) result in more comprehensive and nuanced explanations, covering a broader range of aspects.
• Lower settings (0.5) produce shorter, more concise responses with a focus on key points.
• Increasing temperature and “Top P” settings generally lead to more elaborate, detailed, and expressive language in the generated output.

Temperature 0.5:

• Length: Short and concise response.
• Detail: Provides general advice and considerations but lacks specific examples or elaboration.
• Precision of Language: Uses straightforward language to convey key points.

Temperature 1.5:

• Length: Longer response with detailed explanations and examples.
• Detail: Expands on advantages and provides specific reasons, such as passion, motivation, credibility, trust, and valuable insights.
• Precision of Language: Language is more elaborate, providing nuanced information and insights.

Top P 0.5:

• Length: Short and concise response.
• Detail: Touches on key points without extensive elaboration.
• Precision of Language: Uses straightforward language to convey advantages.

Top P 1:

• Length: Longer response with detailed reasons.
• Detail: Provides more comprehensive insights, covering expertise, passion, motivation, credibility, trust, and competitive advantage.
• Precision of Language: Uses more detailed and expressive language to convey nuanced information.