Generative AI and Copilot: How Does It Work?

How does gen AI work?

Gen AI is a subset of "Artificial Intelligence" (AI) that is built on machine learning. 

Text-based gen AI tools like Microsoft Copilot and ChatGPT are examples of large language models (LLMs).

• Techniques like machine learning ("Deep Learning") are used to analyse large amounts of information.
• Gen AI generates new outputs based on patterns identified in the data it has been trained on.
• E.g. ChatGPT-4 was trained on 1 trillion parameters of text data. It generates new text based on these patterns.

Limitations:

• LLMs are subject to "hallucinations." At times they generate outputs/responses that may look convincing but are not actually correct. 
• Pattern finding is not reasoning
• Gen AI tools do not possess true understanding or consciousness.

 

In summary: Text-based gen AI tools like Copilot and Chat GPT, learn patterns in language from a massive amount of text data available on the internet (and other sources). From these patterns, it generates responses to the questions, commands and prompts we ask it. It is a powerful tool that can help you when used responsibly.

Use it to:

• Understand general concepts (i.e. like using Wikipedia)
• Find alternative keywords (i.e. like using a thesaurus)
• Plan and structure an assignment

Important: It is a tool, not a credible source of information for university level study.

IBM Technology. (2023, July 28). How Large language Models work. YouTube. https://www.youtube.com/watch?v=5sLYAQS9sWQ