Artificial Intelligence in Copilot, Amazon’s AWS, AlphaCode, and AlphaCode: The Impact of Copilot and Meta on Developers Workflows

Last month Meta released a new model for artificial intelligence called Llama 2 which made it possible for anyone to play with the kind of Artificial Intelligence that has enthralled the world for nearly a year.

Meta said that programmers are already using LLMs to assist in a variety of tasks. It is the goal to make developer workflows more efficient so they are more focused on the job at hand.

Code generators are helping developers work. GitHub launched Copilot in March, powered by OpenAI’s GPT-4, to quickly write and check code. GitHub Copilot can also rewrite old code to update it. Amazon’s AWS also has CodeWhisperer, which also writes, checks, and updates code. A code-writing tool is in AlphaCode, but it isn’t out yet.

The tool Copilot can reproduce licensed code is being sued for allegedly violating copyrighted material by the parent company, Microsoft.

Open source and open-source code can make sense of LLMs for research: Code llama, Copilot, and GitHub

“I am excited that they are releasing the weights to the community,” says Deepak Kumar, a PhD student in the Department of Computer Science at Stanford University.

Kumar says the release of Meta’s regular language model led to community discussion of how it behaves and how it can be modified. “It gives us a little bit more flexibility to play with what exactly is going on under the hood, compared to these closed-source models from Google or OpenAI.”

Code llama is valuable for academic research, which is why an assistant professor at the university believes that it will be useful. She says she could see students excited about a code model when they were using Llama models for research. The data used for training could also be released. She says that this is often the missing piece for making sense of research on LLMs.

Copilot, a plug-in for coding programs that auto-completes sections of code based on the first line or comment typed by the user, was launched in May 2021. The GPT model is a large language model behind the chatGPT. That model is trained further using code that GitHub stores for developers, as well as, reportedly, by contractors who are paid to annotate their own code.

GitHub faces a lawsuit for using some open source code in its training data, and Masad says Meta is likely to have limited the training data to avoid such complications. Copilot costs $10 per month for individuals and $19 per month, per user, for businesses.