Generative AI

We are entering a period of generational change in artificial intelligence. Until now, machines have never been able to exhibit behavior indistinguishable from humans. But new generative AI models are not only capable of carrying on sophisticated conversations with users; they also generate seemingly original content.

To gain a competitive edge, business leaders first need to understand what generative AI is.

Generative AI is a set of algorithms, capable of generating seemingly new, realistic content—such as text, images, or audio—from the training data. The most powerful generative AI algorithms are built on top of foundation models that are trained on a vast quantity of unlabeled data in a self-supervised way to identify underlying patterns for a wide range of tasks.

For example, GPT-3.5, a foundation model trained on large volumes of text, can be adapted for answering questions, text summarization, or sentiment analysis. DALL-E, a multimodal (text-to-image) foundation model, can be adapted to create images, expand images beyond their original size, or create variations of existing paintings.

These new types of generative AI have the potential to significantly accelerate AI adoption, even in organizations lacking deep AI or data-science expertise. While significant customization still requires expertise, adopting a generative model for a specific task can be accomplished with relatively low quantities of data or examples through APIs or by prompt engineering. The capabilities that generative AI supports can be summarized into three categories:

• Generating Content and Ideas. Creating new, unique outputs across a range of modalities, such as a video advertisement or even a new protein with antimicrobial properties. 
• Improving Efficiency. Accelerating manual or repetitive tasks, such as writing emails, coding, or summarizing large documents. 
• Personalizing Experiences. Creating content and information tailored to a specific audience, such as chatbots for a personalized customer experiences or targeted advertisements based on patterns in a specific customer's behavior.  

Today, some generative AI models have been trained on large of amounts of data found on the internet, including copyrighted materials. For this reason, responsible AI practices have become an organizational imperative.

Generative AI systems are democratizing AI capabilities that were previously inaccessible due to the lack of training data and computing power required to make them work in each organization’s context. The wider adoption of AI is a good thing, but it can become problematic when organizations don’t have appropriate governance structures in place.

Types of Text Models

• GPT-3, or Generative Pretrained Transformer 3, is an autoregressive model pre-trained on a large corpus of text to generate high-quality natural language text. GPT-3 is designed to be flexible and can be fine-tuned for a variety of language tasks, such as language translation, summarization, and question answering.
• LaMDA, or Language Model for Dialogue Applications, is a pre-trained transformer language model to generate high-quality natural language text, similar to GPT. However, LaMDA was trained on dialogue with the goal of picking up nuances of open-ended conversation.  
• LLaMA is a smaller natural language processing model compared to GPT-4 and LaMDA, with the goal of being as performant. While also being an autoregressive language model based on transformers, LLaMA is trained on more tokens to improve performance with lower numbers of parameters. 

Types of Multimodal Models

• GPT-4 is the latest release of GPT class of models, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. GPT-4 is a transformer-based model pretrained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior.
• DALL-E is a type of multimodal algorithm that can operate across different data modalities and create novel images or artwork from natural language text input. 
• Stable Diffusion is a text-to-image model similar to DALL-E, but uses a process called “diffusion” to gradually reduce noise in the image until it matches the text description. 
• Progen is a multimodal model trained on 280 million protein samples to generate proteins based on desired properties specificized using natural language text input. 

Generative AI text models can be used to generate texts based on natural language instructions, including but not limited to:

• Generate marketing copy and job descriptions 
• Offer conversational SMS support with zero wait time 
• Deliver endless variations on marketing copy 
• Summarize text to enable detailed social listening 
• Search internal documents to increase knowledge transfer within a company 
• Condense lengthy documents into brief summaries 
• Power chatbots 
• Perform data entry 
• Analyze massive datasets 
• Track consumer sentiment 
• Writing software 
• Creating scripts to test code 
• Find common bugs in code 

This is just the beginning. As companies, employees, and customers become more familiar with applications based on AI technology, and as generative AI models become more capable and versatile, we will see a whole new level of applications emerge.

Generative AI has massive implications for business leaders—and many companies have already gone live with generative AI initiatives. In some cases, companies are developing custom generative AI model applications by fine-tuning them with proprietary data.

The benefits businesses can realize utilizing generative AI include:

• Expanding labor productivity 
• Personalizing customer experience 
• Accelerating R&D through generative design 
• Emerging new business models 

Generative AI technology will cause a profound disruption to industries and may ultimately aid in solving some of the most complex problems facing the world today. Three industries have the highest potential for growth in the near term: consumer, finance, and health care.

• Consumer Marketing Campaigns. Generative AI can personalize experiences, content, and product recommendations. 
• Finance. It can generate personalized investment recommendations, analyze market data, and test different scenarios to propose new trading strategies. 
• Biopharma. It can generate data on millions of candidate molecules for a certain disease, then test their application, significantly speeding up R&D cycles.  

Given that the pace the technology is advancing, business leaders in every industry should consider generative AI ready to be built into production systems within the next year—meaning the time to start internal innovation is right now. Companies that don’t embrace the disruptive power of generative AI will find themselves at an enormous—and potentially insurmountable—cost and innovation disadvantage.