2023: The Year of Large Language Models LLMs

In 2023, the field of artificial intelligence witnessed significant advancements, particularly in the field of large language models. The landscape showcased progress, marking an intermediate stage between prior breakthroughs and the anticipation of more powerful advances in the future. Notably, generative AI tools gained mainstream awareness, becoming the center of discussions in the IT industry.

 Major tech companies invested billions in AI technologies, contributing to the transformative impact of AI across various sectors. The year emphasized the widespread adoption of generative AI, with predictions that a significant majority of enterprises would utilize GenAI APIs and models. This article will delve into the noteworthy stories and launches in the AI sector during 2023, shedding light on the impact and trends that shape the future of this industry.

We have categorized them to make it easier to cover maximum tools.

Text Generation

  • Gemini: Google’s Gemini is a powerful AI model positioned as a close competitor to OpenAI’s ChatGPT. Released as an advancement over Google’s PaLM 2, Gemini integrates natural language processing for effective understanding and processing of language in input queries and data. Additionally, it boasts image understanding and recognition capabilities, eliminating the need for external optical character recognition. 
  • Bard:  Google’s Bard is an AI-powered chatbot created by Google that utilizes natural language processing and machine learning to mimic human-like conversation. Trained on a diverse dataset encompassing text, code, and images, Bard also accesses real-time information from the web. This allows Bard to serve as a personal AI assistant, aiding in tasks like email responses, content creation, document translation, and meeting note summarization. 
  • Mistral 7B: It is a powerful language model, boasting 7.3 billion parameters, making it a significant advancement in large language model capabilities. It has innovative features like Grouped-query Attention for faster inference times and Sliding Window Attention for handling longer text sequences efficiently. The model is freely available for download, contributing to the open-source AI community.
  • GPT-4:  OpenAI has launched GPT-4, its latest large language model that accepts both image and text inputs and generates text outputs. GPT-4 focuses on improved alignment, following user intentions while minimizing offensive content. It excels in handling complex prompts and adapting to tones, emotions, and various genres. Capable of processing images, generating code, and understanding 26 languages.
  • Grok: Grok is Elon Musk’s AI chatbot developed by xAI, designed to respond with humor and sarcasm to user text prompts. Using large language model technology, Grok is trained on extensive web data to provide accurate and useful responses to user queries.
  • OverflowAI: It is a new tool from Stack Overflow that combines the platform’s expertise with artificial intelligence, including Natural Language Processing and Generative AI. Overflow.ai uses AI to deliver accurate answers and supports collaboration, making it easier for developers to solve problems and work together effectively. 
  • Llama 2: Llama 2 is Meta AI’s latest large language model, designed to offer enhanced efficiency and safety. Utilizing reinforcement learning and reward modeling, Llama 2 improves decision-making to generate helpful and secure outputs. It is suitable for tasks such as text generation, summarization, and question-answering.

Image Generation

  • Midjourney V.5: Midjourney’s V.5 model is an advanced AI art generator, improving efficiency and resolution. It turns text prompts into images on Discord. Users can also modify uploaded images. Accessible to all, Midjourney is free and open on Discord, allowing users to create, upscale, and share AI-generated art effortlessly.
  • Adobe Firefly: It is a new addition to Adobe’s suite of products, introducing generative AI models for visual content creation. Firefly is designed to generate content brushes, create variations of existing images, and potentially transform photos and videos based on user prompts. The first model, launching as a public beta, focuses on generating images and text effects.
  • Shutterstock: Shutterstock has unveiled its AI image generation platform, utilizing text-to-image technology to transform prompts into licensable imagery. The platform is designed to offer a seamless creative experience. This initiative is a result of Shutterstock’s collaboration with OpenAI.
  • DALL.E 3: OpenAI has introduced DALL·E 3, the latest iteration of its image-generative AI model. Built on ChatGPT, this version enhances user-friendliness by eliminating the need for complex prompt engineering. Operating based on natural language inputs or prompts, the model generates accurate images corresponding to the provided descriptions.
  • Google Imagen 2: Google has launched Imagen 2, an advanced image-generation technology, as part of its Vertex AI suite. This tool transforms text into images using Google DeepMind technology, resulting in improved image quality and introducing new features. Imagen 2 offers capabilities like inpainting, outpainting, and the ability to use a reference image. Individuals can try Imagen 2 by signing up for a free Google Cloud account and accessing it through the Vertex AI suite.

Video Generation

  • Stable Video Diffusion: Stability AI has introduced Stable Video Diffusion, a generative video model, with open-source access on GitHub. This model, designed for sectors like advertising, marketing, TV, film, and gaming, is available through Stability AI’s Developer Platform API. The Stable Video Diffusion focuses on both performance and safety, offering frame interpolation for 24fps video output, along with safety measures and watermarking.
  • Pika: Pika 1.0, developed by Pika Labs, has gained significant popularity. This upgraded AI model empowers users to create and edit videos in diverse styles, including 3D animation, anime, cartoon, and cinematic. Pika 1.0 offers features like text-to-video, image-to-video, and video-to-video conversions, making video creation more accessible and user-friendly for both amateur and professional creators.
  • HeyGen: HeyGen, an innovative AI video generation platform, has been introduced by a startup. It simplifies the video creation process, allowing users to produce high-quality and engaging videos effortlessly. It has features such as AI-assisted voiceovers, customizable avatars, including the option to use one’s own face, and templates for content creation.
  • Runaway Gen-2: Runway has introduced the Gen-2 model, a generative AI that empowers users to effortlessly generate full-fledged videos using text prompts, images, or existing videos. Gen-2 offers eight modes, including Text-to-video, Image-to-video, Stylization, Storyboard, Mask, Render, and Customization. The Storyboard mode transforms mockups into fully stylized and animated renders, providing versatile options for creative video synthesis.
  • VideoPoet: Google’s VideoPoet is an AI model in video creation that offers diverse multimodal features. It excels in text-to-video conversion, image-to-video transformation, video stylization, video inpainting and outpainting, and video-to-audio capabilities. Notably, VideoPoet integrates various video-making functions into one system, using methods like MAGVIT V2 for handling video and images and SoundStream for audio.

Miscellaneous

  • Evodiff: Microsoft’s EvoDiff is an innovative AI framework designed for protein generation, representing a departure from traditional methods. Unlike conventional approaches, EvoDiff doesn’t rely on structural information, making the process faster and cost-effective. Released as open source, EvoDiff has the potential to create enzymes for therapeutics, drug delivery, and industrial chemical reactions without the need for detailed structural data.
  • Segment Anything Model: Meta AI introduces SAM, a powerful segmentation model. It showcases remarkable adaptability by efficiently cutting out objects in images without requiring additional training. The model’s strength lies in its extensive training on a diverse dataset, demonstrating robust performance in object segmentation. 
  • Direct Preference Optimization: Direct Preference Optimization has emerged as a stable and efficient method for fine-tuning large-scale unsupervised language models and teaching text-to-image models. Unlike its counterpart, Reinforcement Learning from Human Feedback (RLHF), DPO eliminates the need for a reward model, offering a direct alternative.
  • Stable audio:  Stability AI’s audio research lab has introduced Stable Audio, a diffusion model for text-controlled audio generation. Users can specify the desired output length in seconds, allowing the model to generate sounds ranging from single instruments to full ensembles or ambient noise like crowd sounds. Stability Audio offers versatility for music production and other audio projects, leveraging the power of diffusion models trained on audio data.

In conclusion, the launch of Large Language Models in 2023 has marked a significant stride in the ever-evolving landscape of artificial intelligence. The unveiling of powerful models like those stated above reflects the continuous efforts to enhance language understanding, generation, and overall AI capabilities. These advancements pave the way for innovative applications across diverse sectors, from natural language processing to code generation and image synthesis. As AI continues to progress, the year 2023 stands as a testament to the ongoing pursuit of refining existing technologies, opening avenues for practical applications, and setting the stage for the next wave of breakthroughs in the field of artificial intelligence.

Manya Goyal is an AI and Research consulting intern at MarktechPost. She is currently pursuing her B.Tech from the Guru Gobind Singh Indraprastha University(Bhagwan Parshuram Institute of Technology). She is a Data Science enthusiast and has a keen interest in the scope of application of artificial intelligence in various fields. She is a podcaster on Spotify and is passionate about exploring.

🐝 Join the Fastest Growing AI Research Newsletter Read by Researchers from Google + NVIDIA + Meta + Stanford + MIT + Microsoft and many others...