ML Kit Release Notes

Latest Versions

iOS API Latest Versions

Artifact nameVersionLast Update
MLKitBarcodeScanning1.1.001/26/2021
MLKitDigitalInkRecognition1.1.001/26/2021
MLKitEntityExtraction1.0.0-beta201/26/2021
MLKitFaceDetection1.1.001/26/2021
MLKitImageLabeling1.1.001/26/2021
MLKitImageLabelingCustom1.1.001/26/2021
MLKitLanguageID1.1.001/26/2021
MLKitLinkFirebase1.1.001/26/2021
MLKitNaturalLanguage1.1.001/26/2021
MLKitObjectDetection1.1.001/26/2021
MLKitObjectDetectionCustom1.1.001/26/2021
MLKitPoseDetection1.0.0-beta201/26/2021
MLKitPoseDetectionAccurate1.0.0-beta201/26/2021
MLKitSmartReply1.1.001/26/2021
MLKitTextRecognition1.1.001/26/2021
MLKitTranslate1.1.001/26/2021

Android API Latest Versions

Group IDArtifact nameVersionLast Update
com.google.android.gmsplay-services-mlkit-barcode-scanning16.1.401/26/2020
com.google.android.gmsplay-services-mlkit-face-detection16.1.301/26/2020
com.google.android.gmsplay-services-mlkit-image-labeling16.0.201/26/2020
com.google.android.gmsplay-services-mlkit-text-recognition16.1.301/26/2020
com.google.mlkitbarcode-scanning16.1.101/26/2020
com.google.mlkitdigital-ink-recognition16.1.008/25/2020
com.google.mlkitentity-extraction16.0.0-beta112/08/2020
com.google.mlkitface-detection16.0.401/26/2020
com.google.mlkitimage-labeling17.0.201/26/2020
com.google.mlkitimage-labeling-custom16.3.101/26/2020
com.google.mlkitlanguage-id16.1.112/08/2020
com.google.mlkitlinkfirebase16.1.012/08/2020
com.google.mlkitobject-detection16.2.301/26/2020
com.google.mlkitobject-detection-custom16.3.101/26/2020
com.google.mlkitpose-detection17.0.1-beta201/26/2020
com.google.mlkitpose-detection-accurate17.0.1-beta201/26/2020
com.google.mlkitsmart-reply16.1.108/25/2020
com.google.mlkittranslate16.1.108/25/2020

Release History

January 26, 2021

This release includes new features, improvements and bug fixes.

iOS API details

The following table lists the iOS APIs that have changed in this release.

Artifact nameVersionUpdated?
MLKitBarcodeScanning1.1.0YES
MLKitDigitalInkRecognition1.1.0YES
MLKitEntityExtraction1.0.0-beta2YES
MLKitFaceDetection1.1.0YES
MLKitImageLabeling1.1.0YES
MLKitImageLabelingCustom1.1.0YES
MLKitLanguageID1.1.0YES
MLKitLinkFirebase1.1.0YES
MLKitNaturalLanguage1.1.0YES
MLKitObjectDetection1.1.0YES
MLKitObjectDetectionCustom1.1.0YES
MLKitPoseDetection1.0.0-beta2YES
MLKitPoseDetectionAccurate1.0.0-beta2YES
MLKitSmartReply1.1.0YES
MLKitTextRecognition1.1.0YES
MLKitTranslate1.1.0YES

Android API details

The following table lists the Android APIs that have changed in this release.

Group IDArtifact nameVersionUpdated?
com.google.android.gmsplay-services-mlkit-barcode-scanning16.1.4YES
com.google.android.gmsplay-services-mlkit-face-detection16.1.3YES
com.google.android.gmsplay-services-mlkit-image-labeling16.0.2YES
com.google.android.gmsplay-services-mlkit-text-recognition16.1.3YES
com.google.mlkitbarcode-scanning16.1.1YES
com.google.mlkitdigital-ink-recognition16.1.0NO
com.google.mlkitentity-extraction16.0.0-beta1NO
com.google.mlkitface-detection16.0.4YES
com.google.mlkitimage-labeling17.0.2YES
com.google.mlkitimage-labeling-custom16.3.1YES
com.google.mlkitlanguage-id16.1.1NO
com.google.mlkitlinkfirebase16.1.0NO
com.google.mlkitobject-detection16.2.3YES
com.google.mlkitobject-detection-custom16.3.1YES
com.google.mlkitpose-detection17.0.1-beta2YES
com.google.mlkitpose-detection-accurate17.0.1-beta2YES
com.google.mlkitsmart-reply16.1.1NO
com.google.mlkittranslate16.1.1NO

New features

Improvements and bug fixes

  • The Pose Detection API recognizes more poses, such as when a user is directly facing the camera while doing squats and pushups.
  • The Pose Detection API base and accurate models are significantly smaller. This change does not impact the quality of the models.
  • The Android Vision APIs have been updated. The size of the unbundled variants in the pull-in SDKs backed by Google Play Services is reduced by approximately 16% (~160KB).

December 8, 2020

This release includes new features, improvements and bug fixes.

iOS API details

The following table lists the iOS APIs that have changed in this release.

Artifact nameVersionUpdated?
MLKitBarcodeScanning1.0.0YES
MLKitDigitalInkRecognition1.0.0YES
MLKitEntityExtraction1.0.0-beta1YES
MLKitFaceDetection1.0.0YES
MLKitImageLabeling1.0.0YES
MLKitImageLabelingCustom1.0.0YES
MLKitLanguageID1.0.0YES
MLKitLinkFirebase1.0.0YES
MLKitNaturalLanguage1.0.0YES
MLKitObjectDetection1.0.0YES
MLKitObjectDetectionCustom1.0.0YES
MLKitPoseDetection1.0.0-beta1YES
MLKitPoseDetectionAccurate1.0.0-beta1YES
MLKitSmartReply1.0.0YES
MLKitTextRecognition1.0.0YES
MLKitTranslate1.0.0YES

Android API details

The following table lists the Android APIs that have changed in this release.

Group IDArtifact nameVersionUpdated?
com.google.android.gmsplay-services-mlkit-barcode-scanning16.1.3YES
com.google.android.gmsplay-services-mlkit-face-detection16.1.2YES
com.google.android.gmsplay-services-mlkit-image-labeling16.0.1YES
com.google.android.gmsplay-services-mlkit-text-recognition16.1.2YES
com.google.mlkitbarcode-scanning16.1.0YES
com.google.mlkitdigital-ink-recognition16.1.0NO
com.google.mlkitentity-extraction16.0.0-beta1YES
com.google.mlkitface-detection16.0.3YES
com.google.mlkitimage-labeling17.0.1YES
com.google.mlkitimage-labeling-custom16.3.0YES
com.google.mlkitlanguage-id16.1.1NO
com.google.mlkitlinkfirebase16.1.0YES
com.google.mlkitobject-detection16.2.2YES
com.google.mlkitobject-detection-custom16.3.0YES
com.google.mlkitpose-detection17.0.1-beta1YES
com.google.mlkitpose-detection-accurate17.0.1-beta1YES
com.google.mlkitsmart-reply16.1.1NO
com.google.mlkittranslate16.1.1NO

New features

  • ML Kit is no longer in Beta. All of ML Kit's APIs (excluding Pose Detection and Entity Extraction) have graduated to General Availability status.

  • Added the Entity Extraction API (Beta). This API allows you to detect and locate entities (e.g. addresses, date/time etc.) from raw text. It supports 11 entity types and 15 languages, using the same technology that powers smart text selection in Android Q+.

    Entity Extraction works fully offline (aside from a one-time download of selected language model, which is ~700KB), and supports both Android and IOS.

Improvements and bug fixes

  • Breaking change: The AutoML image labeling API is removed. Instead, custom image classification models trained using AutoML Vision Edge are now supported by the Custom Image Labeling and Custom Object Detection & Tracking APIs directly.
  • The Custom Image Labeling and Custom Object Detection & Tracking now support remote models that are hosted in Firebase.
    • Added RemoteModelSource, FirebaseModelSource, and CustomRemoteModel classes to support custom models hosted remotely on Firebase server. Also added the support for creating a LocalModel instance from a manifest path of a local custom model trained by AutoML Vision Edge.
    • For the custom image labeling API, added the remote custom model support to the CustomImageLabelerOptions class.
    • For the custom object detection API, added the remote custom model support to the CustomObjectDetectorOptions class.
  • On Android, significantly reduced the SDK size for Vision APIs. For APIs with unbundled variants (backed by Google Play Services) the pull-in SDK's size reduces by ~900KB (~65% of original size). For all other Vision APIs, the pull-in SDK's size reduces by ~600KB. The exception is Digital Ink Recognition, for which the SDK size remains the same.
  • On Android, enabled NNAPI acceleration for Object Detection & Tracking with Base models in STREAM_MODE on selected devices and OSes (Pixel 3, 3XL, 4, 4XL with Android Q or R at the moment), which provides faster model inference and saves energy.
  • On Android, fixed an issue in Barcode Scanning API where it did not work on some devices running with camera-camera2:1.0.0-beta08 version or later.

November 2, 2020

This release includes improvements and bug fixes.

iOS: GoogleMLKit/LinkFirebase 0.64.1

Improvements and bug fixes

  • Upgraded the version range of FirebaseCore dependency in MLKitLinkFirebase from 6.x to 7.x, FirebaseInstanceID dependency from 4.x to 7.x.

October 29, 2020

This release includes improvements and bug fixes.

iOS: GoogleMLKit/Common 0.64.2

Improvements and bug fixes

  • Upgraded the version range of GoogleUtilities/UserDefaults dependency in MLKitCommon from 6.x to 7.x.

October 26, 2020

This release includes improvements and bug fixes.

iOS: GoogleMLKit/Common 0.64.1

Improvements and bug fixes

  • Upgraded the version range of GoogleDataTransport dependency in MLKitCommon from 7.x to 8.x.

September 29, 2020

This release includes new features, improvements and bug fixes.

iOS API Version: 0.64.0

Android API details

The following table lists the Android APIs that have changed in this release.

Group IDArtifact nameVersionUpdated?
com.google.android.gmsplay-services-mlkit-barcode-scanning16.1.2NO
com.google.android.gmsplay-services-mlkit-face-detection16.1.1NO
com.google.android.gmsplay-services-mlkit-image-labeling16.0.0YES
com.google.android.gmsplay-services-mlkit-text-recognition16.1.1NO
com.google.mlkitbarcode-scanning16.0.3NO
com.google.mlkitdigital-ink-recognition16.1.0NO
com.google.mlkitface-detection16.0.2NO
com.google.mlkitimage-labeling17.0.0NO
com.google.mlkitimage-labeling-automl16.2.1NO
com.google.mlkitimage-labeling-custom16.2.1NO
com.google.mlkitlanguage-id16.1.1NO
com.google.mlkitlinkfirebase16.0.1NO
com.google.mlkitobject-detection16.2.1NO
com.google.mlkitobject-detectio-custom16.2.1NO
com.google.mlkitpose-detection17.0.0YES
com.google.mlkitpose-detection-accurate17.0.0YES
com.google.mlkitsmart-reply16.1.1NO
com.google.mlkittranslate16.1.1NO

New features

  • On Android, added a “thin” variant of Image Labeling API, backed by Google Play Services. Reduces size impact to your app by ~3 MB compared to the bundled variant.

Improvements and bug fixes

  • Breaking change: Split Pose Detection into two libraries for size optimization. One library only bundles the fast models, while the other only bundles the accurate models. This helps save the application size, if you only use one set of the models. Same change happened to iOS: The PoseDetection pod now contains only the fast models. To use the accurate models, use the PoseDetectionAccurate pod instead.
  • On iOS, fixed a memory leak which occurred during pose detector deallocation.

August 25, 2020

This release includes new features, improvements and bug fixes.

iOS API Version: 0.63.0

Android API details

The following table lists the Android APIs that have changed in this release.

Group IDArtifact nameVersionUpdated?
com.google.android.gmsplay-services-mlkit-barcode-scanning16.1.2YES
com.google.android.gmsplay-services-mlkit-face-detection16.1.1YES
com.google.android.gmsplay-services-mlkit-text-recognition16.1.1YES
com.google.mlkitbarcode-scanning16.0.3YES
com.google.mlkitdigital-ink-recognition16.1.0YES
com.google.mlkitface-detection16.0.2YES
com.google.mlkitimage-labeling17.0.0YES
com.google.mlkitimage-labeling-automl16.2.1YES
com.google.mlkitimage-labeling-custom16.2.1YES
com.google.mlkitlanguage-id16.1.1YES
com.google.mlkitlinkfirebase16.0.1YES
com.google.mlkitobject-detection16.2.1YES
com.google.mlkitobject-detectio-custom16.2.1YES
com.google.mlkitpose-detection16.0.0YES
com.google.mlkitsmart-reply16.1.1YES
com.google.mlkittranslate16.1.1YES

New features

  • Added the Pose Detection API, a CPU Based, lightweight and versatile solution for developers to track a user’s physical actions in real time within their apps. Pose Detection offers a 33 point skeletal match (with hands and feet tracking) of a users body in real time and has been tuned to work well for complex athletic use cases.

    Pose detection also works fully offline, comes with two operating modes (fast and accurate), and supports both Android and iOS.

Improvements and bug fixes

July 28, 2020

This release includes new features, improvements, and bug fixes.

iOS API Version: 0.62.0

Android API details

The following table lists the Android APIs in this release.

Group IDArtifact nameVersionUpdated?
com.google.android.gmsplay-services-mlkit-barcode-scanning16.1.1YES
com.google.android.gmsplay-services-mlkit-face-detection16.1.0NO
com.google.android.gmsplay-services-mlkit-text-recognition16.1.0NO
com.google.mlkitbarcode-scanning16.0.2YES
com.google.mlkitdigital-ink-recognition16.0.0YES
com.google.mlkitface-detection16.0.1NO
com.google.mlkitimage-labeling16.2.0YES
com.google.mlkitimage-labeling-automl16.2.0YES
com.google.mlkitimage-labeling-custom16.2.0YES
com.google.mlkitlanguage-id16.1.0NO
com.google.mlkitlinkfirebase16.0.0NO
com.google.mlkitobject-detection16.2.0YES
com.google.mlkitobject-detection-custom16.2.0YES
com.google.mlkitsmart-reply16.1.0NO
com.google.mlkittranslate16.1.0NO

New features

  • Added a new Digital Ink Recognition API that recognizes text and shapes handwritten on a digital surface (e.g. touch screens). Supports 300+ languages, as well as emoji and autodraw. It is the same technology that powers handwriting recognition layouts in Gboard, the Google Translate apps and the Quick, Draw! game.

    Digital Ink Recognition works fully offline (aside from a one-time download of language packs), and supports both Android and iOS.

  • On Android, added support for specifying your own custom Executor for running expensive tasks like model loading and inference to Image Labeling and Object Detection and Tracking. With this release, all ML Kit APIs now support custom executors.

    By default, ML Kit uses a highly optimized, internally managed thread pool to run background tasks. This API can help with specialized use cases where developers want to keep full control over the threads in their app instead.

Improvements and bug fixes

  • On Android, for the Barcode Scanning API, fixed rotation handling of the input image.

July 15, 2020

This release includes improvements and bug fixes.

iOS: GoogleMLKit/Common 0.61.1

Improvements and bug fixes

  • Upgraded the version range of GoogleDataTransport dependency in MLKitCommon from 3.2 or higher to 7.0 or higher.
  • Removed the GoogleDataTransportCCTSupport dependency from MLKitCommon.

July 1, 2020

This release includes new features, improvements and bug fixes.

iOS API Version: 0.61.0

Android API details

The following table lists the Android APIs in this release.

Group IDArtifact nameVersionUpdated?
com.google.android.gmsplay-services-mlkit-barcode-scanning16.1.0YES
com.google.android.gmsplay-services-mlkit-face-detection16.1.0YES
com.google.android.gmsplay-services-mlkit-text-recognition16.1.0YES
com.google.mlkitbarcode-scanning16.0.1YES
com.google.mlkitface-detection16.0.1YES
com.google.mlkitimage-labeling16.1.0YES
com.google.mlkitimage-labeling-automl16.1.0YES
com.google.mlkitimage-labeling-custom16.1.0YES
com.google.mlkitlanguage-id16.1.0YES
com.google.mlkitlinkfirebase16.0.0NO
com.google.mlkitobject-detection16.1.0YES
com.google.mlkitobject-detection-custom16.1.0YES
com.google.mlkitsmart-reply16.1.0YES
com.google.mlkittranslate16.1.0YES

New features

  • The Image Labeling and Object Detection and Tracking APIs now support float-based custom models.

  • On Android, added support for specifying your own custom Executor for running expensive tasks like model loading and inference to all APIs except Image Labeling and Object Detection and Tracking.

    By default, ML Kit uses a highly optimized, internally managed thread pool to run background tasks. This API can help with specialized use cases where developers want to keep full control over the threads in their app instead.

Improvements and bug fixes

  • Breaking change: On iOS, for the Barcode Scanning API, fixed a typo in BarcodePersonName and renamed its pronounciation property to pronunciation.
  • Fixed an issue on iOS in the Translate and Smart Reply APIs where the app would crash if the device locale does not specify a region (e.g. "en" instead of "en-US").

June 3, 2020

Android: 16.0.0 / iOS: 0.60.0

This is the first release of ML Kit as a standalone SDK, independent from Firebase. This SDK offers all the on-device APIs that were previously offered through the ML Kit for Firebase SDK. For more information on this change and instructions on migrating your existing apps, please follow our migration guide.

This release includes new features, improvements and bug fixes.

New features

Improvements and bug fixes

  • On Android, included support for Face Contours in “thin” variant of Face Detection API, backed by Google Play Services. Reduces size impact to your app by ~20.3 MB compared to bundled variant.
  • On Android, improved CameraX and Camera2 performance for Barcode Scanning and Face Detection APIs by moving image processing code from Java to native code.
  • Android Jetpack Lifecycle support has been added to all APIs. Developers can use addObserver to automatically manage the initiation and teardown of ML Kit APIs as the app goes through screen rotation or closure by the user / system. This makes CameraX integration easier.
  • Text Recognition API: the most prevalent recognized language is now provided
  • Face Detection API: the Euler X angle of a face is now provided.
  • Barcode Scanning API [bundled]: added support for broken PDF417 start/stop pattern detection, improving recall by 10%.
  • Object Detection and Tracking API: updated localizer model, improving average precision and reducing footprint by ~700KB.

Legacy releases

Changes prior to June 3, 2020 can be found in the Firebase release notes.