--- description: Unofficial Capacitor plugin for the Google ML Kit GenAI SDK to generate natural-language descriptions of images with Gemini Nano on Android. title: Capacitor ML Kit GenAI Image Description Plugin - Capawesome image: https://capawesome.io/docs/assets/images/social/sdks/capacitor/mlkit/genai-image-description.png --- [Skip to content ](#capacitor-ml-kit-genai-image-description-plugin) [πŸ” Introducing the **Capacitor Vault** plugin β€” store secrets behind biometrics or a device passcode. ](/blog/announcing-the-capacitor-vault-plugin/) * [ SDKs ](/docs/sdks/) * [ Formbricks ](/docs/sdks/capacitor/formbricks/) * [ Geocoder ](/docs/sdks/capacitor/geocoder/) * [ Google Sign-In ](/docs/sdks/capacitor/google-sign-in/) * [ Grafana Faro ](/docs/sdks/capacitor/grafana-faro/) * [ Gyroscope ](/docs/sdks/capacitor/gyroscope/) * [ Haptics ](/docs/sdks/capacitor/haptics/) * [ Home Indicator ](/docs/sdks/capacitor/home-indicator/) * [ In-App Browser ](/docs/sdks/capacitor/in-app-browser/) * [ Install Referrer ](/docs/sdks/capacitor/install-referrer/) * [ Keep Awake ](/docs/sdks/capacitor/keep-awake/) * [ libSQL ](/docs/sdks/capacitor/libsql/) * [ Light Sensor ](/docs/sdks/capacitor/light-sensor/) * [ Live Update ](/docs/sdks/capacitor/live-update/) * [ Localization ](/docs/sdks/capacitor/localization/) * [ Mail Composer ](/docs/sdks/capacitor/mail-composer/) * [ Managed Configurations ](/docs/sdks/capacitor/managed-configurations/) * [ Maps Launcher ](/docs/sdks/capacitor/maps-launcher/) * [ Media Session ](/docs/sdks/capacitor/media-session/) * [ ML Kit ](/docs/sdks/capacitor/mlkit/) * [ Usage ](#usage) * [ API ](#api) * [ Enums ](#enums) * [ FAQ ](#faq) * [ Related Plugins ](#related-plugins) * [ Terms & Privacy ](#terms-privacy) * [ Newsletter ](#newsletter) * [ Changelog ](#changelog) * [ License ](#license) * [ GenAI Prompt ](/docs/sdks/capacitor/mlkit/genai-prompt/) * [ GenAI Proofreading ](/docs/sdks/capacitor/mlkit/genai-proofreading/) * [ GenAI Rewriting ](/docs/sdks/capacitor/mlkit/genai-rewriting/) * [ GenAI Speech Recognition ](/docs/sdks/capacitor/mlkit/genai-speech-recognition/) * [ GenAI Summarization ](/docs/sdks/capacitor/mlkit/genai-summarization/) * [ Image Labeling ](/docs/sdks/capacitor/mlkit/image-labeling/) * [ Language Identification ](/docs/sdks/capacitor/mlkit/language-identification/) * [ Object Detection ](/docs/sdks/capacitor/mlkit/object-detection/) * [ Pose Detection ](/docs/sdks/capacitor/mlkit/pose-detection/) * [ Selfie Segmentation ](/docs/sdks/capacitor/mlkit/selfie-segmentation/) * [ Smart Reply ](/docs/sdks/capacitor/mlkit/smart-reply/) * [ Subject Segmentation ](/docs/sdks/capacitor/mlkit/subject-segmentation/) * [ Text Recognition ](/docs/sdks/capacitor/mlkit/text-recognition/) * [ Translation ](/docs/sdks/capacitor/mlkit/translation/) * [ Navigation Bar ](/docs/sdks/capacitor/navigation-bar/) * [ Network ](/docs/sdks/capacitor/network/) * [ NFC ](/docs/sdks/capacitor/nfc/) * [ Node.js ](/docs/sdks/capacitor/nodejs/) * [ OAuth ](/docs/sdks/capacitor/oauth/) * [ Passkeys ](/docs/sdks/capacitor/passkeys/) * [ Password Autofill ](/docs/sdks/capacitor/password-autofill/) * [ PDF Generator ](/docs/sdks/capacitor/pdf-generator/) * [ PDF Viewer ](/docs/sdks/capacitor/pdf-viewer/) * [ Pedometer ](/docs/sdks/capacitor/pedometer/) * [ Permissions ](/docs/sdks/capacitor/permissions/) * [ Phone Dialer ](/docs/sdks/capacitor/phone-dialer/) * [ Photo Editor ](/docs/sdks/capacitor/photo-editor/) * [ Photo Manipulator ](/docs/sdks/capacitor/photo-manipulator/) * [ PixLive ](/docs/sdks/capacitor/pixlive/) * [ PostHog ](/docs/sdks/capacitor/posthog/) * [ Printer ](/docs/sdks/capacitor/printer/) * [ Privacy Screen ](/docs/sdks/capacitor/privacy-screen/) * [ Proximity Sensor ](/docs/sdks/capacitor/proximity-sensor/) * [ Purchases ](/docs/sdks/capacitor/purchases/) * [ RealtimeKit ](/docs/sdks/capacitor/realtimekit/) * [ Root Detection ](/docs/sdks/capacitor/root-detection/) * [ Screen Brightness ](/docs/sdks/capacitor/screen-brightness/) * [ Screen Orientation ](/docs/sdks/capacitor/screen-orientation/) * [ Screen Reader ](/docs/sdks/capacitor/screen-reader/) * [ Screenshot ](/docs/sdks/capacitor/screenshot/) * [ Secure Preferences ](/docs/sdks/capacitor/secure-preferences/) * [ Settings Launcher ](/docs/sdks/capacitor/settings-launcher/) * [ Shake ](/docs/sdks/capacitor/shake/) * [ Silent Mode ](/docs/sdks/capacitor/silent-mode/) * [ SIM ](/docs/sdks/capacitor/sim/) * [ SMS Composer ](/docs/sdks/capacitor/sms-composer/) * [ Speech Recognition ](/docs/sdks/capacitor/speech-recognition/) * [ Speech Synthesis ](/docs/sdks/capacitor/speech-synthesis/) * [ Share Target ](/docs/sdks/capacitor/share-target/) * [ Square Mobile Payments ](/docs/sdks/capacitor/square-mobile-payments/) * [ SQLite ](/docs/sdks/capacitor/sqlite/) * [ Superwall ](/docs/sdks/capacitor/superwall/) * [ System WebView ](/docs/sdks/capacitor/system-webview/) * [ Text Interaction ](/docs/sdks/capacitor/text-interaction/) * [ Text Zoom ](/docs/sdks/capacitor/text-zoom/) * [ Thermal State ](/docs/sdks/capacitor/thermal-state/) * [ Toast ](/docs/sdks/capacitor/toast/) * [ Torch ](/docs/sdks/capacitor/torch/) * [ Vault ](/docs/sdks/capacitor/vault/) * [ Volume ](/docs/sdks/capacitor/volume/) * [ Wallet ](/docs/sdks/capacitor/wallet/) * [ Wifi ](/docs/sdks/capacitor/wifi/) * [ Zip ](/docs/sdks/capacitor/zip/) * [ Cordova ](/docs/sdks/cordova/) * [ Cloud ](/docs/cloud/) * [ Integrations ](/docs/cloud/live-updates/integrations/) * Concepts * Reference * [ Troubleshooting ](/docs/cloud/live-updates/troubleshooting/) * [ FAQ ](/docs/cloud/live-updates/faq/) * [ Native Builds ](/docs/cloud/native-builds/) * [ Set Up Environments ](/docs/cloud/native-builds/environments/) * [ Overwrite Native Configurations ](/docs/cloud/native-builds/native-configurations/) * [ Auto-Increment Build Numbers ](/docs/cloud/native-builds/auto-incrementing-build-numbers/) * [ Configure the Web Build Script ](/docs/cloud/native-builds/web-build-script/) * [ Build from a Monorepo ](/docs/cloud/native-builds/monorepo/) * [ Use pnpm, Yarn, or bun ](/docs/cloud/native-builds/package-managers/) * [ Install Private npm Packages ](/docs/cloud/native-builds/npm-private-registry/) * [ Override the Java Version ](/docs/cloud/native-builds/override-java-version/) * [ Custom iOS Provisioning Profiles ](/docs/cloud/native-builds/custom-ios-provisioning-profiles/) * [ Build without Git ](/docs/cloud/native-builds/build-without-git/) * [ Access Git Behind a Firewall ](/docs/cloud/native-builds/firewall-access/) * [ Integrations ](/docs/cloud/native-builds/integrations/) * Reference * [ Troubleshooting ](/docs/cloud/native-builds/troubleshooting/) * [ FAQ ](/docs/cloud/native-builds/faq/) * [ App Store Publishing ](/docs/cloud/app-store-publishing/) * [ Submit a Build ](/docs/cloud/app-store-publishing/submit-a-build/) * [ Submit Automatically After a Build ](/docs/cloud/app-store-publishing/submit-automatically/) * [ Troubleshooting ](/docs/cloud/app-store-publishing/troubleshooting/) * [ FAQ ](/docs/cloud/app-store-publishing/faq/) * [ Automations ](/docs/cloud/automations/) * [ Reference ](/docs/cloud/automations/reference/) * [ Troubleshooting ](/docs/cloud/automations/troubleshooting/) * [ FAQ ](/docs/cloud/automations/faq/) * [ Assist ](/docs/cloud/assist/) * [ CLI ](/docs/cloud/cli/) * APIs and SDKs * [ Webhooks ](/docs/cloud/webhooks/) * [ Integrations ](/docs/cloud/integrations/) * Account * [ Organization ](/docs/cloud/organizations/) * [ Two-Factor Enforcement ](/docs/cloud/organizations/two-factor-authentication/) * [ Audit Logs ](/docs/cloud/organizations/audit-logs/) * [ Billing ](/docs/cloud/organizations/billing/) * [ License Keys ](/docs/cloud/license-keys/) * [ AI ](/docs/ai/) * [ Insiders ](/docs/insiders/) * [ Billing & Plans ](/docs/insiders/billing-and-plans/) * [ FAQ ](/docs/insiders/faq/) * [ License ](https://capawesome.io/legal/eula/) * [ Support ](/docs/support/) * [ Contributing ](/docs/contributing/) * Contributing code * [ Code of Conduct ](/docs/contributing/code-of-conduct/) * [ Questions ](https://docs.github.com/en/discussions/collaborating-with-your-community-using-discussions/participating-in-a-discussion#creating-a-discussion) * [ Blog ](/blog/) * Categories * [ Usage ](#usage) * [ API ](#api) * [ Enums ](#enums) * [ FAQ ](#faq) * [ Related Plugins ](#related-plugins) * [ Terms & Privacy ](#terms-privacy) * [ Newsletter ](#newsletter) * [ Changelog ](#changelog) * [ License ](#license) # Capacitor ML Kit GenAI Image Description Plugin[ΒΆ](#capacitor-ml-kit-genai-image-description-plugin "Permanent link") Unofficial Capacitor plugin for [ML Kit GenAI Image Description](https://developers.google.com/ml-kit/genai/image-description).[1](#fn:1) > \[!WARNING\] The ML Kit GenAI APIs are currently in **beta**. The API surface and behavior may change in future releases. [ ![Deliver Live Updates to your Capacitor app with Capawesome Cloud](../../../../assets/external/cloud.capawesome.io/assets/banners/cloud-build-and-deploy-capacitor-apps.69628c3f.png) ](https://cloud.capawesome.io/) ## Use Cases[ΒΆ](#use-cases "Permanent link") The GenAI Image Description plugin is typically used to generate a natural-language description of an image on-device using Gemini Nano, for example: * **Accessibility**: Generate alternative text for images to support screen readers. * **Content moderation**: Get a textual summary of user-uploaded images. * **Search and organization**: Describe images to make them searchable or to auto-tag a photo library. ## Requirements[ΒΆ](#requirements "Permanent link") This plugin uses [Gemini Nano](https://developers.google.com/ml-kit/genai), which runs entirely on-device. It is only available on Android and has the following device requirements: * The device must support Gemini Nano (see [supported devices](https://developers.google.com/ml-kit/genai#supported%5Fdevices)). * The device must run Android API level 26 or higher. * The device must not have an unlocked bootloader. Use the `checkFeatureStatus(...)` method to check whether the feature is available on the device. ## Compatibility[ΒΆ](#compatibility "Permanent link") | Plugin Version | Capacitor Version | Status | | -------------- | ----------------- | -------------- | | 8.x.x | \>=8.x.x | Active support | ## Installation[ΒΆ](#installation "Permanent link") You can use our **AI-Assisted Setup** to install the plugin. Add the [Capawesome Skills](https://github.com/capawesome-team/skills) to your AI tool using the following command: `[](#%5F%5Fcodelineno-0-1)npx skills add capawesome-team/skills --skill capacitor-plugins ` Then use the following prompt: `` [](#%5F%5Fcodelineno-1-1)Use the `capacitor-plugins` skill from `capawesome-team/skills` to install the `@capacitor-mlkit/genai-image-description` plugin in my project. `` If you prefer **Manual Setup**, install the plugin by running the following commands and follow the platform-specific instructions below: `[](#%5F%5Fcodelineno-2-1)npm install @capacitor-mlkit/genai-image-description [](#%5F%5Fcodelineno-2-2)npx cap sync ` ### Android[ΒΆ](#android "Permanent link") #### API level[ΒΆ](#api-level "Permanent link") This plugin requires a minimum API level of 26\. Make sure to set the `minSdkVersion` in your `variables.gradle` file to at least `26`. #### Variables[ΒΆ](#variables "Permanent link") This plugin will use the following project variables (defined in your app’s `variables.gradle` file): * `$mlkitGenaiImageDescriptionVersion` version of `com.google.mlkit:genai-image-description` (default: `1.0.0-beta1`) ## Usage[ΒΆ](#usage "Permanent link") The following example shows how to check the feature status, download the feature and describe an image. > The image description is currently only available in English. ### Check the feature status[ΒΆ](#check-the-feature-status "Permanent link") Before using the image description feature, check whether it is available on the device: `[](#%5F%5Fcodelineno-3-1)import { [](#%5F%5Fcodelineno-3-2) FeatureStatus, [](#%5F%5Fcodelineno-3-3) GenAiImageDescription, [](#%5F%5Fcodelineno-3-4)} from '@capacitor-mlkit/genai-image-description'; [](#%5F%5Fcodelineno-3-5) [](#%5F%5Fcodelineno-3-6)const checkFeatureStatus = async () => { [](#%5F%5Fcodelineno-3-7) const { featureStatus } = await GenAiImageDescription.checkFeatureStatus(); [](#%5F%5Fcodelineno-3-8) return featureStatus === FeatureStatus.Available; [](#%5F%5Fcodelineno-3-9)}; ` ### Download the feature[ΒΆ](#download-the-feature "Permanent link") If the feature status is `DOWNLOADABLE`, download the feature before using it. Add a listener for the `downloadProgress` event to get notified about the download progress: `[](#%5F%5Fcodelineno-4-1)import { GenAiImageDescription } from '@capacitor-mlkit/genai-image-description'; [](#%5F%5Fcodelineno-4-2) [](#%5F%5Fcodelineno-4-3)const downloadFeature = async () => { [](#%5F%5Fcodelineno-4-4) await GenAiImageDescription.addListener('downloadProgress', event => { [](#%5F%5Fcodelineno-4-5) console.log('Total bytes downloaded:', event.totalBytesDownloaded); [](#%5F%5Fcodelineno-4-6) }); [](#%5F%5Fcodelineno-4-7) await GenAiImageDescription.downloadFeature(); [](#%5F%5Fcodelineno-4-8)}; ` ### Describe an image[ΒΆ](#describe-an-image "Permanent link") Pass the local file path of the image to `describeImage(...)` to generate a description. Add a listener for the `inferenceProgress` event to receive partial results as they are generated: `[](#%5F%5Fcodelineno-5-1)import { GenAiImageDescription } from '@capacitor-mlkit/genai-image-description'; [](#%5F%5Fcodelineno-5-2) [](#%5F%5Fcodelineno-5-3)const describeImage = async () => { [](#%5F%5Fcodelineno-5-4) await GenAiImageDescription.addListener('inferenceProgress', event => { [](#%5F%5Fcodelineno-5-5) console.log('Partial result:', event.text); [](#%5F%5Fcodelineno-5-6) }); [](#%5F%5Fcodelineno-5-7) const { description } = await GenAiImageDescription.describeImage({ [](#%5F%5Fcodelineno-5-8) path: 'file:///path/to/image.jpg', [](#%5F%5Fcodelineno-5-9) }); [](#%5F%5Fcodelineno-5-10) return description; [](#%5F%5Fcodelineno-5-11)}; ` ## API[ΒΆ](#api "Permanent link") * [checkFeatureStatus()](#checkfeaturestatus) * [describeImage(...)](#describeimage) * [downloadFeature()](#downloadfeature) * [addListener('downloadProgress', ...)](#addlistenerdownloadprogress-) * [addListener('inferenceProgress', ...)](#addlistenerinferenceprogress-) * [removeAllListeners()](#removealllisteners) * [Interfaces](#interfaces) * [Enums](#enums) ### checkFeatureStatus()[ΒΆ](#checkfeaturestatus "Permanent link") `[](#%5F%5Fcodelineno-6-1)checkFeatureStatus() => Promise ` Check the current availability status of the image description feature. If the status is `DOWNLOADABLE`, you can download the feature using `downloadFeature(...)`. Only available on Android. **Returns:** `Promise<[CheckFeatureStatusResult](#checkfeaturestatusresult)>` **Since:** 8.2.0 --- ### describeImage(...)[ΒΆ](#describeimage "Permanent link") `[](#%5F%5Fcodelineno-7-1)describeImage(options: DescribeImageOptions) => Promise ` Generate a natural-language description of the given image. The `inferenceProgress` event listener will notify you about partial results as they are generated. The returned promise resolves with the full result. The description is currently only available in English. Only available on Android. | Param | Type | | ----------- | --------------------------------------------- | | **options** | [DescribeImageOptions](#describeimageoptions) | **Returns:** `Promise<[DescribeImageResult](#describeimageresult)>` **Since:** 8.2.0 --- ### downloadFeature()[ΒΆ](#downloadfeature "Permanent link") `[](#%5F%5Fcodelineno-8-1)downloadFeature() => Promise ` Download the image description feature. The `downloadProgress` event listener will notify you about the download progress. The returned promise resolves when the download is complete or the feature is already available. Only available on Android. **Since:** 8.2.0 --- ### addListener('downloadProgress', ...)[ΒΆ](#addlistenerdownloadprogress "Permanent link") `[](#%5F%5Fcodelineno-9-1)addListener(eventName: 'downloadProgress', listenerFunc: (event: DownloadProgressEvent) => void) => Promise ` Called while the image description feature is being downloaded. Only available on Android. | Param | Type | | ---------------- | ---------------------------------------------------------------- | | **eventName** | 'downloadProgress' | | **listenerFunc** | (event: [DownloadProgressEvent](#downloadprogressevent)) => void | **Returns:** `Promise<[PluginListenerHandle](#pluginlistenerhandle)>` **Since:** 8.2.0 --- ### addListener('inferenceProgress', ...)[ΒΆ](#addlistenerinferenceprogress "Permanent link") `[](#%5F%5Fcodelineno-10-1)addListener(eventName: 'inferenceProgress', listenerFunc: (event: InferenceProgressEvent) => void) => Promise ` Called when a new partial result is available during inference. Only available on Android. | Param | Type | | ---------------- | ------------------------------------------------------------------ | | **eventName** | 'inferenceProgress' | | **listenerFunc** | (event: [InferenceProgressEvent](#inferenceprogressevent)) => void | **Returns:** `Promise<[PluginListenerHandle](#pluginlistenerhandle)>` **Since:** 8.2.0 --- ### removeAllListeners()[ΒΆ](#removealllisteners "Permanent link") `[](#%5F%5Fcodelineno-11-1)removeAllListeners() => Promise ` Remove all listeners for this plugin. **Since:** 8.2.0 --- ### Interfaces[ΒΆ](#interfaces "Permanent link") #### CheckFeatureStatusResult[ΒΆ](#checkfeaturestatusresult "Permanent link") | Prop | Type | Description | Since | | ----------------- | ------------------------------- | ----------------------------------------------------------------- | ----- | | **featureStatus** | [FeatureStatus](#featurestatus) | The current availability status of the image description feature. | 8.2.0 | #### DescribeImageResult[ΒΆ](#describeimageresult "Permanent link") | Prop | Type | Description | Since | | --------------- | ------ | ---------------------------------------------- | ----- | | **description** | string | The natural-language description of the image. | 8.2.0 | #### DescribeImageOptions[ΒΆ](#describeimageoptions "Permanent link") | Prop | Type | Description | Since | | -------- | ------ | --------------------------------------------- | ----- | | **path** | string | The local file path of the image to describe. | 8.2.0 | #### PluginListenerHandle[ΒΆ](#pluginlistenerhandle "Permanent link") | Prop | Type | | ---------- | ------------------- | | **remove** | () => Promise | #### DownloadProgressEvent[ΒΆ](#downloadprogressevent "Permanent link") | Prop | Type | Description | Since | | ------------------------ | ------ | -------------------------------------------- | ----- | | **totalBytesDownloaded** | number | The total number of bytes downloaded so far. | 8.2.0 | #### InferenceProgressEvent[ΒΆ](#inferenceprogressevent "Permanent link") | Prop | Type | Description | Since | | -------- | ------ | ----------------------------------- | ----- | | **text** | string | The new text of the partial result. | 8.2.0 | ### Enums[ΒΆ](#enums "Permanent link") #### FeatureStatus[ΒΆ](#featurestatus "Permanent link") | Members | Value | Description | Since | | ---------------- | -------------- | --------------------------------------------------------- | ----- | | **Available** | 'AVAILABLE' | The feature is available to use. | 8.2.0 | | **Downloadable** | 'DOWNLOADABLE' | The feature can be downloaded using downloadFeature(...). | 8.2.0 | | **Downloading** | 'DOWNLOADING' | The feature is currently being downloaded. | 8.2.0 | | **Unavailable** | 'UNAVAILABLE' | The feature is not available on this device. | 8.2.0 | ## FAQ[ΒΆ](#faq "Permanent link") ### What are the requirements to use this plugin?[ΒΆ](#what-are-the-requirements-to-use-this-plugin "Permanent link") The image description is performed on-device by Gemini Nano. This requires a device that supports Gemini Nano, Android API level 26 or higher and a locked bootloader (see [Requirements](#requirements)). Use the `checkFeatureStatus(...)` method to check whether the feature is available on the device. ### Why is this plugin only available on Android?[ΒΆ](#why-is-this-plugin-only-available-on-android "Permanent link") The ML Kit GenAI APIs are based on Gemini Nano and AICore, which are currently only available on Android. On iOS and Web, all methods reject with an appropriate error. ### In which language is the description generated?[ΒΆ](#in-which-language-is-the-description-generated "Permanent link") The image description is currently only available in English. Support for more languages is planned for future releases. ### How do I get the description as a stream?[ΒΆ](#how-do-i-get-the-description-as-a-stream "Permanent link") Add a listener for the `inferenceProgress` event before calling `describeImage(...)`. The listener is called with each partial result as it is generated. The promise returned by `describeImage(...)` resolves with the full result. ### Can I use this plugin with Ionic, React, Vue or Angular?[ΒΆ](#can-i-use-this-plugin-with-ionic-react-vue-or-angular "Permanent link") Yes, the plugin is framework-agnostic. It works in any Capacitor app regardless of the web framework, including Ionic with Angular, React, or Vue, as well as plain JavaScript projects. ## Related Plugins[ΒΆ](#related-plugins "Permanent link") * [Translation](https://capawesome.io/docs/sdks/capacitor/mlkit/translation/): Unofficial Capacitor plugin for ML Kit Translation. * [Smart Reply](https://capawesome.io/docs/sdks/capacitor/mlkit/smart-reply/): Unofficial Capacitor plugin for ML Kit Smart Reply. ## Terms & Privacy[ΒΆ](#terms-privacy "Permanent link") This plugin uses the [Google ML Kit](https://developers.google.com/ml-kit): * [Terms & Privacy](https://developers.google.com/ml-kit/terms) * [Android Data Disclosure](https://developers.google.com/ml-kit/android-data-disclosure) * [iOS Data Disclosure](https://developers.google.com/ml-kit/ios-data-disclosure) ## Newsletter[ΒΆ](#newsletter "Permanent link") Stay up to date with the latest news and updates about the Capawesome, Capacitor, and Ionic ecosystem by subscribing to our [Capawesome Newsletter](https://cloud.capawesome.io/newsletter/). ## Changelog[ΒΆ](#changelog "Permanent link") See [CHANGELOG.md](https://github.com/capawesome-team/capacitor-mlkit/blob/main/packages/genai-image-description/CHANGELOG.md). ## License[ΒΆ](#license "Permanent link") See [LICENSE](https://github.com/capawesome-team/capacitor-mlkit/blob/main/packages/genai-image-description/LICENSE). --- 1. This project is not affiliated with, endorsed by, sponsored by, or approved by Google LLC or any of their affiliates or subsidiaries. [↩](#fnref:1 "Jump back to footnote 1 in the text") July 10, 2026 Back to top ```json {"@context": "https://schema.org", "@graph": [{"@type": "TechArticle", "@id": "https://capawesome.io/docs/sdks/capacitor/mlkit/genai-image-description/#article", "headline": "Capacitor ML Kit GenAI Image Description Plugin", "name": "Capacitor ML Kit GenAI Image Description Plugin", "description": "Unofficial Capacitor plugin for the Google ML Kit GenAI SDK to generate natural-language descriptions of images with Gemini Nano on Android.", "inLanguage": "en", "url": "https://capawesome.io/docs/sdks/capacitor/mlkit/genai-image-description/", "mainEntityOfPage": "https://capawesome.io/docs/sdks/capacitor/mlkit/genai-image-description/", "author": {"@type": "Organization", "name": "Capawesome", "url": "https://capawesome.io", "logo": {"@type": "ImageObject", "url": "https://capawesome.io/assets/images/logo.svg"}}, "publisher": {"@type": "Organization", "name": "Capawesome", "url": "https://capawesome.io", "logo": {"@type": "ImageObject", "url": "https://capawesome.io/assets/images/logo.svg"}}, "about": {"@id": "https://capawesome.io/docs/sdks/capacitor/mlkit/genai-image-description/#software"}}, {"@type": "SoftwareSourceCode", "@id": "https://capawesome.io/docs/sdks/capacitor/mlkit/genai-image-description/#software", "name": "Capacitor ML Kit GenAI Image Description Plugin", "description": "Unofficial Capacitor plugin for the Google ML Kit GenAI SDK to generate natural-language descriptions of images with Gemini Nano on Android.", "url": "https://capawesome.io/docs/sdks/capacitor/mlkit/genai-image-description/", "programmingLanguage": "TypeScript", "runtimePlatform": "Capacitor", "codeRepository": "https://github.com/capawesome-team", "author": {"@type": "Organization", "name": "Capawesome", "url": "https://capawesome.io", "logo": {"@type": "ImageObject", "url": "https://capawesome.io/assets/images/logo.svg"}}, "publisher": {"@type": "Organization", "name": "Capawesome", "url": "https://capawesome.io", "logo": {"@type": "ImageObject", "url": "https://capawesome.io/assets/images/logo.svg"}}}]} {"@context": "https://schema.org", "@type": "FAQPage", "mainEntity": [{"@type": "Question", "name": "What are the requirements to use this plugin?", "acceptedAnswer": {"@type": "Answer", "text": "The image description is performed on-device by Gemini Nano. This requires a device that supports Gemini Nano, Android API level 26 or higher and a locked bootloader (see Requirements). Use the checkFeatureStatus(...) method to check whether the feature is available on the device."}}, {"@type": "Question", "name": "Why is this plugin only available on Android?", "acceptedAnswer": {"@type": "Answer", "text": "The ML Kit GenAI APIs are based on Gemini Nano and AICore, which are currently only available on Android. On iOS and Web, all methods reject with an appropriate error."}}, {"@type": "Question", "name": "In which language is the description generated?", "acceptedAnswer": {"@type": "Answer", "text": "The image description is currently only available in English. Support for more languages is planned for future releases."}}, {"@type": "Question", "name": "How do I get the description as a stream?", "acceptedAnswer": {"@type": "Answer", "text": "Add a listener for the inferenceProgress event before calling describeImage(...). The listener is called with each partial result as it is generated. The promise returned by describeImage(...) resolves with the full result."}}, {"@type": "Question", "name": "Can I use this plugin with Ionic, React, Vue or Angular?", "acceptedAnswer": {"@type": "Answer", "text": "Yes, the plugin is framework-agnostic. It works in any Capacitor app regardless of the web framework, including Ionic with Angular, React, or Vue, as well as plain JavaScript projects."}}], "url": "https://capawesome.io/docs/sdks/capacitor/mlkit/genai-image-description/"} ```