Data Import
Understanding Importers in the 2050-Materials Platform
Overview
The 2050-Materials platform uses a series of importers to gather and process environmental data about construction materials from various sources. These importers are crucial for ensuring that the data integrated into our platform is accurate, consistent, and aligned with our standards.
How Importers Work
Four-Stage Process
API Calls: The importers begin by making requests to various APIs to collect raw data.
Cleaning and Processing: The raw data is then cleaned and transformed to ensure quality and usability.
Constructing Dataframe: The cleaned data is structured into dataframes that align with our platform's requirements.
Data Import: Finally, the processed data is uploaded to the 2050-Materials platform using our API.
Key Features
Predefined Mapping: Classifies products from different sources into our predefined categories of product types, material types, and building applications for consistency.
Unit Matching and Rescaling: Converts and adjusts units to a standard set for comparability, especially in LCA (Life Cycle Assessment) fields.
Detailed Data Processing
Technical Characteristics
Collects crucial technical characteristics like mass, density, grammage, and linear density, enabling unit conversion and enhancing data utility.
LCA Fields
Gathers comprehensive LCA data fields like fresh water use, energy use, and emissions, contributing to a thorough environmental impact assessment of materials.
Execution and Scheduling
Server and Scheduling: The importers run on an external server and are scheduled periodically using
crontab.Customization: Importers like EC3, Eco Platform, and Toxnot have specific arguments for fine-tuned control over the data import process.
Conclusion
The importers are a backbone of the 2050-Materials platform, ensuring that we continually receive, process, and integrate high-quality data from a variety of sources. This mechanism supports our commitment to providing accurate and up-to-date environmental data about construction materials.
Note: This document is intended for customers of the 2050-Materials platform, providing an overview of our importers and their role in data integration.
Last updated