Latest Versions
iOS API Latest Versions
Artifact name | Version | Last Update |
---|---|---|
MLKitBarcodeScanning | 1.1.0 | 01/26/2021 |
MLKitDigitalInkRecognition | 1.1.0 | 01/26/2021 |
MLKitEntityExtraction | 1.0.0-beta2 | 01/26/2021 |
MLKitFaceDetection | 1.1.0 | 01/26/2021 |
MLKitImageLabeling | 1.1.0 | 01/26/2021 |
MLKitImageLabelingCustom | 1.1.0 | 01/26/2021 |
MLKitLanguageID | 1.1.0 | 01/26/2021 |
MLKitLinkFirebase | 1.1.0 | 01/26/2021 |
MLKitNaturalLanguage | 1.1.0 | 01/26/2021 |
MLKitObjectDetection | 1.1.0 | 01/26/2021 |
MLKitObjectDetectionCustom | 1.1.0 | 01/26/2021 |
MLKitPoseDetection | 1.0.0-beta2 | 01/26/2021 |
MLKitPoseDetectionAccurate | 1.0.0-beta2 | 01/26/2021 |
MLKitSmartReply | 1.1.0 | 01/26/2021 |
MLKitTextRecognition | 1.1.0 | 01/26/2021 |
MLKitTranslate | 1.1.0 | 01/26/2021 |
Android API Latest Versions
Group ID | Artifact name | Version | Last Update |
---|---|---|---|
com.google.android.gms | play-services-mlkit-barcode-scanning | 16.1.4 | 01/26/2020 |
com.google.android.gms | play-services-mlkit-face-detection | 16.1.3 | 01/26/2020 |
com.google.android.gms | play-services-mlkit-image-labeling | 16.0.2 | 01/26/2020 |
com.google.android.gms | play-services-mlkit-text-recognition | 16.1.3 | 01/26/2020 |
com.google.mlkit | barcode-scanning | 16.1.1 | 01/26/2020 |
com.google.mlkit | digital-ink-recognition | 16.1.0 | 08/25/2020 |
com.google.mlkit | entity-extraction | 16.0.0-beta1 | 12/08/2020 |
com.google.mlkit | face-detection | 16.0.4 | 01/26/2020 |
com.google.mlkit | image-labeling | 17.0.2 | 01/26/2020 |
com.google.mlkit | image-labeling-custom | 16.3.1 | 01/26/2020 |
com.google.mlkit | language-id | 16.1.1 | 12/08/2020 |
com.google.mlkit | linkfirebase | 16.1.0 | 12/08/2020 |
com.google.mlkit | object-detection | 16.2.3 | 01/26/2020 |
com.google.mlkit | object-detection-custom | 16.3.1 | 01/26/2020 |
com.google.mlkit | pose-detection | 17.0.1-beta2 | 01/26/2020 |
com.google.mlkit | pose-detection-accurate | 17.0.1-beta2 | 01/26/2020 |
com.google.mlkit | smart-reply | 16.1.1 | 08/25/2020 |
com.google.mlkit | translate | 16.1.1 | 08/25/2020 |
Release History
January 26, 2021
This release includes new features, improvements and bug fixes.
iOS API details
The following table lists the iOS APIs that have changed in this release.
Artifact name | Version | Updated? |
---|---|---|
MLKitBarcodeScanning | 1.1.0 | YES |
MLKitDigitalInkRecognition | 1.1.0 | YES |
MLKitEntityExtraction | 1.0.0-beta2 | YES |
MLKitFaceDetection | 1.1.0 | YES |
MLKitImageLabeling | 1.1.0 | YES |
MLKitImageLabelingCustom | 1.1.0 | YES |
MLKitLanguageID | 1.1.0 | YES |
MLKitLinkFirebase | 1.1.0 | YES |
MLKitNaturalLanguage | 1.1.0 | YES |
MLKitObjectDetection | 1.1.0 | YES |
MLKitObjectDetectionCustom | 1.1.0 | YES |
MLKitPoseDetection | 1.0.0-beta2 | YES |
MLKitPoseDetectionAccurate | 1.0.0-beta2 | YES |
MLKitSmartReply | 1.1.0 | YES |
MLKitTextRecognition | 1.1.0 | YES |
MLKitTranslate | 1.1.0 | YES |
Android API details
The following table lists the Android APIs that have changed in this release.
Group ID | Artifact name | Version | Updated? |
---|---|---|---|
com.google.android.gms | play-services-mlkit-barcode-scanning | 16.1.4 | YES |
com.google.android.gms | play-services-mlkit-face-detection | 16.1.3 | YES |
com.google.android.gms | play-services-mlkit-image-labeling | 16.0.2 | YES |
com.google.android.gms | play-services-mlkit-text-recognition | 16.1.3 | YES |
com.google.mlkit | barcode-scanning | 16.1.1 | YES |
com.google.mlkit | digital-ink-recognition | 16.1.0 | NO |
com.google.mlkit | entity-extraction | 16.0.0-beta1 | NO |
com.google.mlkit | face-detection | 16.0.4 | YES |
com.google.mlkit | image-labeling | 17.0.2 | YES |
com.google.mlkit | image-labeling-custom | 16.3.1 | YES |
com.google.mlkit | language-id | 16.1.1 | NO |
com.google.mlkit | linkfirebase | 16.1.0 | NO |
com.google.mlkit | object-detection | 16.2.3 | YES |
com.google.mlkit | object-detection-custom | 16.3.1 | YES |
com.google.mlkit | pose-detection | 17.0.1-beta2 | YES |
com.google.mlkit | pose-detection-accurate | 17.0.1-beta2 | YES |
com.google.mlkit | smart-reply | 16.1.1 | NO |
com.google.mlkit | translate | 16.1.1 | NO |
New features
- New Z Coordinate support in the Pose Detection API.
Improvements and bug fixes
- The Pose Detection API recognizes more poses, such as when a user is directly facing the camera while doing squats and pushups.
- The Pose Detection API base and accurate models are significantly smaller. This change does not impact the quality of the models.
- The Android Vision APIs have been updated. The size of the unbundled variants in the pull-in SDKs backed by Google Play Services is reduced by approximately 16% (~160KB).
December 8, 2020
This release includes new features, improvements and bug fixes.
iOS API details
The following table lists the iOS APIs that have changed in this release.
Artifact name | Version | Updated? |
---|---|---|
MLKitBarcodeScanning | 1.0.0 | YES |
MLKitDigitalInkRecognition | 1.0.0 | YES |
MLKitEntityExtraction | 1.0.0-beta1 | YES |
MLKitFaceDetection | 1.0.0 | YES |
MLKitImageLabeling | 1.0.0 | YES |
MLKitImageLabelingCustom | 1.0.0 | YES |
MLKitLanguageID | 1.0.0 | YES |
MLKitLinkFirebase | 1.0.0 | YES |
MLKitNaturalLanguage | 1.0.0 | YES |
MLKitObjectDetection | 1.0.0 | YES |
MLKitObjectDetectionCustom | 1.0.0 | YES |
MLKitPoseDetection | 1.0.0-beta1 | YES |
MLKitPoseDetectionAccurate | 1.0.0-beta1 | YES |
MLKitSmartReply | 1.0.0 | YES |
MLKitTextRecognition | 1.0.0 | YES |
MLKitTranslate | 1.0.0 | YES |
Android API details
The following table lists the Android APIs that have changed in this release.
Group ID | Artifact name | Version | Updated? |
---|---|---|---|
com.google.android.gms | play-services-mlkit-barcode-scanning | 16.1.3 | YES |
com.google.android.gms | play-services-mlkit-face-detection | 16.1.2 | YES |
com.google.android.gms | play-services-mlkit-image-labeling | 16.0.1 | YES |
com.google.android.gms | play-services-mlkit-text-recognition | 16.1.2 | YES |
com.google.mlkit | barcode-scanning | 16.1.0 | YES |
com.google.mlkit | digital-ink-recognition | 16.1.0 | NO |
com.google.mlkit | entity-extraction | 16.0.0-beta1 | YES |
com.google.mlkit | face-detection | 16.0.3 | YES |
com.google.mlkit | image-labeling | 17.0.1 | YES |
com.google.mlkit | image-labeling-custom | 16.3.0 | YES |
com.google.mlkit | language-id | 16.1.1 | NO |
com.google.mlkit | linkfirebase | 16.1.0 | YES |
com.google.mlkit | object-detection | 16.2.2 | YES |
com.google.mlkit | object-detection-custom | 16.3.0 | YES |
com.google.mlkit | pose-detection | 17.0.1-beta1 | YES |
com.google.mlkit | pose-detection-accurate | 17.0.1-beta1 | YES |
com.google.mlkit | smart-reply | 16.1.1 | NO |
com.google.mlkit | translate | 16.1.1 | NO |
New features
- ML Kit is no longer in Beta. All of ML Kit's APIs (excluding Pose Detection and Entity Extraction) have graduated to General Availability status.
Added the Entity Extraction API (Beta). This API allows you to detect and locate entities (e.g. addresses, date/time etc.) from raw text. It supports 11 entity types and 15 languages, using the same technology that powers smart text selection in Android Q+.
Entity Extraction works fully offline (aside from a one-time download of selected language model, which is ~700KB), and supports both Android and IOS.
Improvements and bug fixes
- Breaking change: The AutoML image labeling API is removed. Instead, custom image classification models trained using AutoML Vision Edge are now supported by the Custom Image Labeling and Custom Object Detection & Tracking APIs directly.
- The Custom Image Labeling
and Custom Object Detection & Tracking
now support remote models that are hosted in Firebase.
- Added
RemoteModelSource
,FirebaseModelSource
, andCustomRemoteModel
classes to support custom models hosted remotely on Firebase server. Also added the support for creating aLocalModel
instance from a manifest path of a local custom model trained by AutoML Vision Edge. - For the custom image labeling API, added the remote custom model support to
the
CustomImageLabelerOptions
class. - For the custom object detection API, added the remote custom model support to
the
CustomObjectDetectorOptions
class.
- Added
- On Android, significantly reduced the SDK size for Vision APIs. For APIs with unbundled variants (backed by Google Play Services) the pull-in SDK's size reduces by ~900KB (~65% of original size). For all other Vision APIs, the pull-in SDK's size reduces by ~600KB. The exception is Digital Ink Recognition, for which the SDK size remains the same.
- On Android, enabled NNAPI acceleration for
Object Detection & Tracking with Base models in
STREAM_MODE
on selected devices and OSes (Pixel 3, 3XL, 4, 4XL with Android Q or R at the moment), which provides faster model inference and saves energy. - On Android, fixed an issue in Barcode Scanning API where it did not work on some devices running with camera-camera2:1.0.0-beta08 version or later.
November 2, 2020
This release includes improvements and bug fixes.
iOS: GoogleMLKit/LinkFirebase 0.64.1
Improvements and bug fixes
- Upgraded the version range of FirebaseCore dependency in MLKitLinkFirebase from 6.x to 7.x, FirebaseInstanceID dependency from 4.x to 7.x.
October 29, 2020
This release includes improvements and bug fixes.
iOS: GoogleMLKit/Common 0.64.2
Improvements and bug fixes
- Upgraded the version range of GoogleUtilities/UserDefaults dependency in MLKitCommon from 6.x to 7.x.
October 26, 2020
This release includes improvements and bug fixes.
iOS: GoogleMLKit/Common 0.64.1
Improvements and bug fixes
- Upgraded the version range of GoogleDataTransport dependency in MLKitCommon from 7.x to 8.x.
September 29, 2020
This release includes new features, improvements and bug fixes.
iOS API Version: 0.64.0
Android API details
The following table lists the Android APIs that have changed in this release.
Group ID | Artifact name | Version | Updated? |
---|---|---|---|
com.google.android.gms | play-services-mlkit-barcode-scanning | 16.1.2 | NO |
com.google.android.gms | play-services-mlkit-face-detection | 16.1.1 | NO |
com.google.android.gms | play-services-mlkit-image-labeling | 16.0.0 | YES |
com.google.android.gms | play-services-mlkit-text-recognition | 16.1.1 | NO |
com.google.mlkit | barcode-scanning | 16.0.3 | NO |
com.google.mlkit | digital-ink-recognition | 16.1.0 | NO |
com.google.mlkit | face-detection | 16.0.2 | NO |
com.google.mlkit | image-labeling | 17.0.0 | NO |
com.google.mlkit | image-labeling-automl | 16.2.1 | NO |
com.google.mlkit | image-labeling-custom | 16.2.1 | NO |
com.google.mlkit | language-id | 16.1.1 | NO |
com.google.mlkit | linkfirebase | 16.0.1 | NO |
com.google.mlkit | object-detection | 16.2.1 | NO |
com.google.mlkit | object-detectio-custom | 16.2.1 | NO |
com.google.mlkit | pose-detection | 17.0.0 | YES |
com.google.mlkit | pose-detection-accurate | 17.0.0 | YES |
com.google.mlkit | smart-reply | 16.1.1 | NO |
com.google.mlkit | translate | 16.1.1 | NO |
New features
- On Android, added a “thin” variant of Image Labeling API, backed by Google Play Services. Reduces size impact to your app by ~3 MB compared to the bundled variant.
Improvements and bug fixes
- Breaking change: Split Pose Detection into two libraries for size optimization. One library only bundles the fast models, while the other only bundles the accurate models. This helps save the application size, if you only use one set of the models. Same change happened to iOS: The PoseDetection pod now contains only the fast models. To use the accurate models, use the PoseDetectionAccurate pod instead.
- On iOS, fixed a memory leak which occurred during pose detector deallocation.
August 25, 2020
This release includes new features, improvements and bug fixes.
iOS API Version: 0.63.0
Android API details
The following table lists the Android APIs that have changed in this release.
Group ID | Artifact name | Version | Updated? |
---|---|---|---|
com.google.android.gms | play-services-mlkit-barcode-scanning | 16.1.2 | YES |
com.google.android.gms | play-services-mlkit-face-detection | 16.1.1 | YES |
com.google.android.gms | play-services-mlkit-text-recognition | 16.1.1 | YES |
com.google.mlkit | barcode-scanning | 16.0.3 | YES |
com.google.mlkit | digital-ink-recognition | 16.1.0 | YES |
com.google.mlkit | face-detection | 16.0.2 | YES |
com.google.mlkit | image-labeling | 17.0.0 | YES |
com.google.mlkit | image-labeling-automl | 16.2.1 | YES |
com.google.mlkit | image-labeling-custom | 16.2.1 | YES |
com.google.mlkit | language-id | 16.1.1 | YES |
com.google.mlkit | linkfirebase | 16.0.1 | YES |
com.google.mlkit | object-detection | 16.2.1 | YES |
com.google.mlkit | object-detectio-custom | 16.2.1 | YES |
com.google.mlkit | pose-detection | 16.0.0 | YES |
com.google.mlkit | smart-reply | 16.1.1 | YES |
com.google.mlkit | translate | 16.1.1 | YES |
New features
Added the Pose Detection API, a CPU Based, lightweight and versatile solution for developers to track a user’s physical actions in real time within their apps. Pose Detection offers a 33 point skeletal match (with hands and feet tracking) of a users body in real time and has been tuned to work well for complex athletic use cases.
Pose detection also works fully offline, comes with two operating modes (fast and accurate), and supports both Android and iOS.
Improvements and bug fixes
- Added support to create a LocalModel with a URI on Android.
- New Latin script recognizers for Filipino (
fil
/tl
), Uzbek (uz-Latn
), and Berber (ber-Latn
) in Digital Ink Recognition. - Improved models for Cyrillic script languages in Digital Ink Recognition.
- Changed the Hebrew language code from
iw
tohe
in Language Identification on Android sinceiw
is deprecated in BCP-47.
July 28, 2020
This release includes new features, improvements, and bug fixes.
iOS API Version: 0.62.0
Android API details
The following table lists the Android APIs in this release.
Group ID | Artifact name | Version | Updated? |
---|---|---|---|
com.google.android.gms | play-services-mlkit-barcode-scanning | 16.1.1 | YES |
com.google.android.gms | play-services-mlkit-face-detection | 16.1.0 | NO |
com.google.android.gms | play-services-mlkit-text-recognition | 16.1.0 | NO |
com.google.mlkit | barcode-scanning | 16.0.2 | YES |
com.google.mlkit | digital-ink-recognition | 16.0.0 | YES |
com.google.mlkit | face-detection | 16.0.1 | NO |
com.google.mlkit | image-labeling | 16.2.0 | YES |
com.google.mlkit | image-labeling-automl | 16.2.0 | YES |
com.google.mlkit | image-labeling-custom | 16.2.0 | YES |
com.google.mlkit | language-id | 16.1.0 | NO |
com.google.mlkit | linkfirebase | 16.0.0 | NO |
com.google.mlkit | object-detection | 16.2.0 | YES |
com.google.mlkit | object-detection-custom | 16.2.0 | YES |
com.google.mlkit | smart-reply | 16.1.0 | NO |
com.google.mlkit | translate | 16.1.0 | NO |
New features
Added a new Digital Ink Recognition API that recognizes text and shapes handwritten on a digital surface (e.g. touch screens). Supports 300+ languages, as well as emoji and autodraw. It is the same technology that powers handwriting recognition layouts in Gboard, the Google Translate apps and the Quick, Draw! game.
Digital Ink Recognition works fully offline (aside from a one-time download of language packs), and supports both Android and iOS.
On Android, added support for specifying your own custom Executor for running expensive tasks like model loading and inference to Image Labeling and Object Detection and Tracking. With this release, all ML Kit APIs now support custom executors.
By default, ML Kit uses a highly optimized, internally managed thread pool to run background tasks. This API can help with specialized use cases where developers want to keep full control over the threads in their app instead.
Improvements and bug fixes
- On Android, for the Barcode Scanning API, fixed rotation handling of the input image.
July 15, 2020
This release includes improvements and bug fixes.
iOS: GoogleMLKit/Common 0.61.1
Improvements and bug fixes
- Upgraded the version range of GoogleDataTransport dependency in MLKitCommon from 3.2 or higher to 7.0 or higher.
- Removed the GoogleDataTransportCCTSupport dependency from MLKitCommon.
July 1, 2020
This release includes new features, improvements and bug fixes.
iOS API Version: 0.61.0
Android API details
The following table lists the Android APIs in this release.
Group ID | Artifact name | Version | Updated? |
---|---|---|---|
com.google.android.gms | play-services-mlkit-barcode-scanning | 16.1.0 | YES |
com.google.android.gms | play-services-mlkit-face-detection | 16.1.0 | YES |
com.google.android.gms | play-services-mlkit-text-recognition | 16.1.0 | YES |
com.google.mlkit | barcode-scanning | 16.0.1 | YES |
com.google.mlkit | face-detection | 16.0.1 | YES |
com.google.mlkit | image-labeling | 16.1.0 | YES |
com.google.mlkit | image-labeling-automl | 16.1.0 | YES |
com.google.mlkit | image-labeling-custom | 16.1.0 | YES |
com.google.mlkit | language-id | 16.1.0 | YES |
com.google.mlkit | linkfirebase | 16.0.0 | NO |
com.google.mlkit | object-detection | 16.1.0 | YES |
com.google.mlkit | object-detection-custom | 16.1.0 | YES |
com.google.mlkit | smart-reply | 16.1.0 | YES |
com.google.mlkit | translate | 16.1.0 | YES |
New features
- The Image Labeling and Object Detection and Tracking APIs now support float-based custom models.
On Android, added support for specifying your own custom Executor for running expensive tasks like model loading and inference to all APIs except Image Labeling and Object Detection and Tracking.
By default, ML Kit uses a highly optimized, internally managed thread pool to run background tasks. This API can help with specialized use cases where developers want to keep full control over the threads in their app instead.
Improvements and bug fixes
- Breaking change: On iOS, for the Barcode Scanning API, fixed a typo in
BarcodePersonName
and renamed itspronounciation
property topronunciation
. - Fixed an issue on iOS in the Translate and Smart Reply APIs where the app would crash if the device locale does not specify a region (e.g. "en" instead of "en-US").
June 3, 2020
Android: 16.0.0 / iOS: 0.60.0
This is the first release of ML Kit as a standalone SDK, independent from Firebase. This SDK offers all the on-device APIs that were previously offered through the ML Kit for Firebase SDK. For more information on this change and instructions on migrating your existing apps, please follow our migration guide.
This release includes new features, improvements and bug fixes.
New features
- New Custom Image Labeling and Custom Object Detection and Tracking APIs, making it easy to use custom image classification models (pre-trained, or newly trained from a range of sources) in your apps and build real-time interactive experiences for users.
Improvements and bug fixes
- On Android, included support for Face Contours in “thin” variant of Face Detection API, backed by Google Play Services. Reduces size impact to your app by ~20.3 MB compared to bundled variant.
- On Android, improved CameraX and Camera2 performance for Barcode Scanning and Face Detection APIs by moving image processing code from Java to native code.
- Android Jetpack Lifecycle
support has been added to all APIs. Developers can use
addObserver
to automatically manage the initiation and teardown of ML Kit APIs as the app goes through screen rotation or closure by the user / system. This makes CameraX integration easier. - Text Recognition API: the most prevalent recognized language is now provided
- Face Detection API: the Euler X angle of a face is now provided.
- Barcode Scanning API [bundled]: added support for broken PDF417 start/stop pattern detection, improving recall by 10%.
- Object Detection and Tracking API: updated localizer model, improving average precision and reducing footprint by ~700KB.
Legacy releases
Changes prior to June 3, 2020 can be found in the Firebase release notes.