> For the complete documentation index, see [llms.txt](https://docs.2050-materials.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.2050-materials.com/data-documentation/data-import.md).

# Data Import

How importers bring EPD and LCA data from each source into the 2050 Materials platform, in four stages.

## Understanding Importers in the 2050-Materials Platform <a href="#understanding-importers-in-the-2050-materials-platform" id="understanding-importers-in-the-2050-materials-platform"></a>

### Overview <a href="#overview" id="overview"></a>

The 2050-Materials platform uses a series of importers to gather and process environmental data about construction materials from various sources. These importers are crucial for ensuring that the data integrated into our platform is accurate, consistent, and aligned with our standards.

### How Importers Work <a href="#how-importers-work" id="how-importers-work"></a>

#### Four-Stage Process <a href="#four-stage-process" id="four-stage-process"></a>

1. **API Calls**: The importers begin by making requests to various APIs to collect raw data.
2. **Cleaning and Processing**: The raw data is then cleaned and transformed to ensure quality and usability.
3. **Constructing Dataframe**: The cleaned data is structured into dataframes that align with our platform's requirements.
4. **Data Import**: Finally, the processed data is loaded into the 2050-Materials platform. Customers read it through the platform and the read-only API endpoints.

#### Key Features <a href="#key-features" id="key-features"></a>

* **Predefined Mapping**: Classifies products from different sources into our predefined categories of product types, material types, and building applications for consistency.
* **Unit Matching and Rescaling**: Converts and adjusts units to a standard set for comparability, especially in LCA (Life Cycle Assessment) fields.

### Detailed Data Processing <a href="#detailed-data-processing" id="detailed-data-processing"></a>

#### Technical Characteristics <a href="#technical-characteristics" id="technical-characteristics"></a>

Collects crucial technical characteristics like mass, density, grammage, and linear density, enabling unit conversion and enhancing data utility.

#### LCA Fields <a href="#lca-fields" id="lca-fields"></a>

Gathers comprehensive LCA data fields like fresh water use, energy use, and emissions, contributing to a thorough environmental impact assessment of materials.

#### Execution and Scheduling <a href="#execution-and-scheduling" id="execution-and-scheduling"></a>

The importers run periodically, so new and updated records from each source reach the platform over time. [Data Sources](https://docs.2050-materials.com/data-documentation/data-sources.md) lists the sources.

### Conclusion <a href="#conclusion" id="conclusion"></a>

The importers are a backbone of the 2050-Materials platform, ensuring that we continually receive, process, and integrate high-quality data from a variety of sources. This mechanism supports our commitment to providing accurate and up-to-date environmental data about construction materials.

***

*Note: This document is intended for customers of the 2050-Materials platform, providing an overview of our importers and their role in data integration.*
