Galaxy AI: Samsung Infuses S24 Series with AI Features
The launch of the Samsung Galaxy S24 series marked a significant shift, heavily emphasizing a suite of on-device and cloud-based AI features marketed under the umbrella term "Galaxy AI." These innovations aim to enhance core smartphone experiences like communication, creativity, productivity, and search, often leveraging partnerships, notably with Google and its Gemini AI models.
Galaxy AI introduces functionalities designed to improve everyday life, particularly focusing on the phone's fundamental role: communication. One standout feature is Live Translate, offering two-way, real-time voice and text translation during phone calls directly within the native call app. Samsung highlighted that for many languages, this translation happens on-device, ensuring privacy as conversations don't necessarily need to be processed externally. This real-time, integrated approach aimed to overcome the latency and lack of natural flow often associated with previous translation tools.
While translation tools existed before, Galaxy AI aimed for seamless integration. The Interpreter feature facilitates live conversations, displaying translations on a split-screen so individuals facing each other can read the text transcription of what the other person said. This function was designed to work even without mobile data or Wi-Fi for downloaded language packs.
For messaging and other apps, Chat Assist helps users refine their conversational tone, ensuring messages sound as intended, whether professional or casual. Integrated into the Samsung Keyboard, it can also translate messages in real-time across numerous supported languages (initially 13 at launch). In vehicles, Android Auto integration allows for summaries of incoming messages and suggests relevant replies and actions, like sending an ETA, promoting safer communication while driving.
Productivity also gets an AI boost. Note Assist within Samsung Notes can generate AI-powered summaries, automatically format notes using pre-made templates, and create covers for easy identification. For voice recordings, Transcript Assist uses speech-to-text technology to transcribe, summarize, and even translate recordings, even distinguishing between multiple speakers.
Search capabilities were enhanced with Circle to Search with Google. This feature, debuting on the S24 series and Google's Pixel 8 phones, allows users to long-press the home button or navigation bar, then circle, highlight, scribble on, or tap anything on their screen (images, videos, text) to initiate a Google search without switching apps.
Creativity, particularly photography, received significant attention under the "ProVisual Engine" banner within Galaxy AI. This suite includes AI-powered tools transforming the imaging experience from capture to sharing. Enhancements aimed to improve zoom quality, utilizing AI processing alongside the camera hardware (like the 50MP sensor and optical zoom lenses) to deliver high-quality results across various magnification levels (e.g., 2x, 3x, 5x, 10x).
Post-capture, Generative Edit offers powerful AI-based photo editing capabilities within the native Gallery app. Users can easily move or remove objects or people, and the AI fills in the resulting empty space, tasks that previously required dedicated desktop software like Photoshop. It can also straighten images and fill in the generated borders. Additionally, Edit Suggestion provides AI-powered recommendations tailored to each photo for quick optimizations.
In summary, the key "Galaxy AI" features highlighted at launch included:
- Live Translate: Real-time, two-way voice and text translations for phone calls.
- Interpreter: Instant translation of live conversations in a split-screen view, with offline capability.
- Chat Assist: Helps perfect message tones and offers real-time translation within the keyboard.
- Note Assist: AI-powered summarization, auto-formatting, and cover creation for notes.
- Transcript Assist: Transcribes, summarizes, and translates voice recordings.
- Circle to Search with Google: Intuitive visual search initiated by simple gestures on screen.
- AI-Powered Camera (ProVisual Engine): Enhanced zoom, low-light performance, and other capture improvements.
- Generative Edit & Edit Suggestion: Advanced, AI-driven photo editing integrated into the Gallery app.
Samsung stated these Galaxy AI features would be provided free of charge until at least the end of 2025 on supported Samsung Galaxy devices. However, reports (like from The Verge) noted that Samsung left open the possibility of charging for some AI features in the future. This potential shift could be attributed to the significant server costs associated with running powerful cloud-based AI models, particularly for features provided by third parties or requiring substantial cloud processing.