FHIR Data Pipes
View source on GitHub
FHIR Data Pipes is a set of ETL pipelines for transforming FHIR data into an
SQL-capable format for building analytics services. FHIR Data Pipes is designed
with horizontal scalability in mind and offers multiple deployment options.
The features include:
Apache Beam ETL pipelines to transform
data from a FHIR source into an SQL-on-FHIR schema data warehouse, based on
Apache Parquet files that can be queried using SQL
(see Parquet-on-FHIR schema)
Controller Module for managing the FHIR Data Pipes Pipelines, integrating
"full", "incremental", and "merger" pipelines together. Using the controller
module you can schedule periodic incremental updates or use the Web Control
Panel to start the pipeline manually.
Implementation of the SQL-on-FHIR-v2 specification
making it possible to apply ViewDefinition resources to generate flat views
within the pipelines (see View layer)
Go to developer documentation
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-11-26 UTC.
[null,null,["Last updated 2024-11-26 UTC."],[[["FHIR Data Pipes is a scalable ETL toolset that transforms FHIR data into an SQL-compatible format for analytics."],["It utilizes Apache Beam pipelines to create a data warehouse based on an SQL-on-FHIR schema using Parquet files."],["A controller module allows for managing and scheduling pipeline updates, including full, incremental, and merging processes."],["FHIR Data Pipes supports the SQL-on-FHIR-v2 specification for generating simplified views of the data."]]],["FHIR Data Pipes provides ETL pipelines to convert FHIR data into an SQL-ready format using Apache Beam. These pipelines create a data warehouse based on Apache Parquet files, enabling SQL queries. A Controller Module manages \"full,\" \"incremental,\" and \"merger\" pipelines, allowing scheduled or manual updates. The system implements the SQL-on-FHIR-v2 specification, supporting ViewDefinition resources to create flat views within the pipelines. It offers scalability and multiple deployment options for analytics services.\n"]]
