ChatGPT update: You can now give prompts using voice commands & images; here’s how to do it

OpenAI, the company behind the popular generative AI assistant ChatGPT, is expanding its capabilities by introducing voice and image-based search features to the chatbot.

This development marks a significant evolution in the generative AI landscape, making ChatGPT a more interactive and versatile tool for users. OpenAI CEO Sam Altman shared this new update with a tweet that read, "voice mode and vision for chatgpt! really worth a try."

Voice Conversations With ChatGPT

Users can now engage in voice conversations with ChatGPT, allowing them to interact with the AI assistant in a more conversational manner. This feature enables users to ask questions verbally and receive spoken word responses from ChatGPT.

For example, users can request ChatGPT to create a bedtime story or seek answers to their queries through voice commands.

OpenAI has collaborated with established voice actors to develop five distinct voices for this feature, using their open-source Whisper speech recognition system to transcribe spoken words into text. However, OpenAI is cautious about potential misuse, acknowledging the risk of malicious actors impersonating public figures or committing fraud.

Image-Based Search & Analysis

In addition to voice, ChatGPT users can now utilise image-based search and analysis. They can upload images and ask ChatGPT to provide explanations or instructions related to the content of the image. This feature adds a new dimension to ChatGPT's capabilities, making it a valuable tool for tasks such as troubleshooting, meal planning, or data analysis.

How to Access The New Features

The voice and image features will be available to ChatGPT Plus and Enterprise subscribers in the coming two weeks.

• To activate the voice features, navigate to the 'settings' menu within the app.
• Then select 'new features', and opt-in to voice conversations.

These features will initially be available on the ChatGPT Android and iOS apps in an opt-in beta format, with image search becoming a default feature across all platforms.

Spotify Partnership

OpenAI has also entered into a partnership with Spotify, enabling podcasters to use ChatGPT's voice technology to translate their shows into multiple languages while preserving their original voices. This collaboration offers podcasters a practical way to reach broader audiences.

Balancing Innovation With Responsibility

OpenAI acknowledges the potential benefits of these new features, such as creative and accessibility-focused applications. However, they are also aware of the risks associated with synthetic voices and image analysis capabilities. To mitigate these risks, OpenAI is taking a controlled and selective approach, limiting access to these technologies to specific use cases and partners.