Pipeline-ETL: CAD (BIM) project verification
26 February 2024
Validation of human requirements in life
26 February 2024

New ETL concepts – AIA, BEP, IDS, LOD, COBie

In the mid-2000s the construction industry encountered an unprecedented challenge due to the rapid expansion of data in data management and processing systems, particularly those originating from CAD (BIM) departments. This surge in data volume caught company executives and managers off guard, leaving them unprepared for the growing data quality and data management requirements.

Taking advantage of the lack of open data & open solutions and limited competition in the data processing market, and using marketing campaigns related to the new acronym BIM from CAD (BIM) vendors, new organisations have begun to create new standards and concepts that de jure should be aimed at improving data management practices.

While almost all initiatives directly or indirectly supported by CAD (BIM) vendors have focused on optimizing workflows, they have resulted in a plethora of standards lobbied by various stakeholders, leading the construction industry to some ambiguity and confusion about data processes.

Let's list some of the new data standards that have emerged over the last years in the construction industry:

  • BEP (BIM Execution Plan) describes how to integrate and utilize CAD (BIM) in a project by defining data handling methods and processes.
  • EIR / AIA (Employer's Information Requirements) document, which is prepared by the client prior to the invitation to tender and contains the requirements for the contractor with regard to the preparation and delivery of information. It serves as the basis for the BEP in the respective project.
  • AIM (Asset Information Model) - As part of the BIM process. Once the project is handed over and completed, the data model is called the "Asset Information Model" or AIM. The purpose of the AIM is to manage, maintain and operate the realized asset.
  • IDS (Information Delivery Specification) determines what data and in what format is required at different stages of a construction project.
  • LOD (Level Of Detail) indicates the level of detail of the CAD (BIM) model at different stages of design.
  • APS (Autodesk® Platform Services) and similar tools from closed application vendors, describes the tools and infrastructure from CAD (BIM) vendors needed to create linked and open data models.

 

Most of the new concepts in the field of data handling in the construction industry offer a variety of approaches that must be harmonized with the marketing strategies of CAD vendors using BIM (Building Information Modeling). As a result, the concepts and some of the existing construction industry standards developed and promoted by interested companies in the last decades are often found to be redundant or even counterproductive in business processes. Instead of simplifying data processing, they create additional complexities.

One of the latest examples of new concepts is the IDS format, which allows to describe the requirements for the attribute composition of an information model - it creates information on attributes and their boundary values in a structured table form, which is then translated into XML format markup, which is called the IDS format.

As a result, the construction industry is coming up with more and more new ideas for data control and management every year, overlooking the fact that data in construction projects is no different from data in other industries, and that other industries, having uniform data processing methods, do not need similar requirements and concepts.

Although CAD (BIM) tool developers may give the impression of uniqueness in handling data in the construction, in reality the construction industry does not stand out with special information processing requirements compared to other industries.

The number of requirements for projects and CAD (BIM) formats can be simplified by using a unified requirements table with attribute-columns, described in detail in the chapter "Translating Requirements into Structured Form", without having to translate the originally structured requirements into non-table formats.

A simplified approach that includes columns for identifier, property, and validation rules bypasses the need to convert requirements to IDS-XML or COBie format, offering a direct and less cumbersome way to ensure data quality. A simplified structured requirements structure includes the basic attributes and the required level of detail: the grouping data attribute (Type or Category), the names of the attributes to be checked and their boundary values.

The methods and tools used to collect, prepare and analyze data in construction should not be fundamentally different from those used by professionals in other sectors of the economy.

While concepts and marketing acronyms come and go, the data requirements validation processes themselves will forever be an integral part of corporate processes, just as requirements and validation affect the daily lives of the people who make decisions based on old and new incoming information on a daily basis.

Leave a Reply

Change language

Post's Highlights

    Stay updated: news and insights



    We’re Here to Help

    Fresh solutions are released through our social channels

    UNLOCK THE POWER OF DATA
     IN CONSTRUCTION

    Dive into the world of data-driven construction with this accessible guide, perfect for professionals and novices alike.
    From the basics of data management to cutting-edge trends in digital transformation, this book
    will be your comprehensive guide to using data in the construction industry.

    Related posts 

    Focus Areas

    navigate
    • ALL THE CHAPTERS IN THIS PART
    • A PRACTICAL GUIDE TO IMPLEMENTING A DATA-DRIVEN APPROACH (8)
    • CLASSIFICATION AND INTEGRATION: A COMMON LANGUAGE FOR CONSTRUCTION DATA (8)
    • DATA FLOW WITHOUT MANUAL EFFORT: WHY ETL (8)
    • DATA INFRASTRUCTURE: FROM STORAGE FORMATS TO DIGITAL REPOSITORIES (8)
    • DATA UNIFICATION AND STRUCTURING (7)
    • SYSTEMATIZATION OF REQUIREMENTS AND VALIDATION OF INFORMATION (7)
    • COST CALCULATIONS AND ESTIMATES FOR CONSTRUCTION PROJECTS (6)
    • EMERGENCE OF BIM-CONCEPTS IN THE CONSTRUCTION INDUSTRY (6)
    • MACHINE LEARNING AND PREDICTIONS (6)
    • BIG DATA AND ITS ANALYSIS (5)
    • DATA ANALYTICS AND DATA-DRIVEN DECISION-MAKING (5)
    • DATA CONVERSION INTO A STRUCTURED FORM (5)
    • DESIGN PARAMETERIZATION AND USE OF LLM FOR CAD OPERATION (5)
    • GEOMETRY IN CONSTRUCTION: FROM LINES TO CUBIC METERS (5)
    • LLM AND THEIR ROLE IN DATA PROCESSING AND BUSINESS PROCESSES (5)
    • ORCHESTRATION OF ETL AND WORKFLOWS: PRACTICAL SOLUTIONS (5)
    • SURVIVAL STRATEGIES: BUILDING COMPETITIVE ADVANTAGE (5)
    • 4D-6D and Calculation of Carbon Dioxide Emissions (4)
    • CONSTRUCTION ERP AND PMIS SYSTEMS (4)
    • COST AND SCHEDULE FORECASTING USING MACHINE LEARNING (4)
    • DATA WAREHOUSE MANAGEMENT AND CHAOS PREVENTION (4)
    • EVOLUTION OF DATA USE IN THE CONSTRUCTION INDUSTRY (4)
    • IDE WITH LLM SUPPORT AND FUTURE PROGRAMMING CHANGES (4)
    • QUANTITY TAKE-OFF AND AUTOMATIC CREATION OF ESTIMATES AND SCHEDULES (4)
    • THE DIGITAL REVOLUTION AND THE EXPLOSION OF DATA (4)
    • Uncategorized (4)
    • CLOSED PROJECT FORMATS AND INTEROPERABILITY ISSUES (3)
    • MANAGEMENT SYSTEMS IN CONSTRUCTION (3)
    • AUTOMATIC ETL CONVEYOR (PIPELINE) (2)

    Search

    Search

    057 Speed of decision making depends on data quality

    Today’s design data architecture is undergoing fundamental changes. The industry is moving away from bulky, isolated models and closed formats towards more flexible, machine-readable structures focused on analytics, integration and process automation. However, the transition...

    060 A common language of construction the role of classifiers in digital transformation

    In the context of digitalization and automation of inspection and processing processes, a special role is played by classification systems elements – a kind of “digital dictionaries” that ensure uniformity in the description and parameterization...

    061 Masterformat, OmniClass, Uniclass and CoClass the evolution of classification systems

    Historically, construction element and work classifiers have evolved in three generations, each reflecting the level of available technology and the current needs of the industry in a particular time period (Fig. 4.2-8): First generation (early...

    Don't miss the new solutions

     

     

    Linux

    macOS

    Looking for the Linux or MAC version? Send us a quick message using the button below, and we’ll guide you through the process!


    📥 Download OnePager

    Welcome to DataDrivenConstruction—where data meets innovation in the construction industry. Our One-Pager offers a concise overview of how our data-driven solutions can transform your projects, enhance efficiency, and drive sustainable growth. 

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DDC terms of use 

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    DataDrivenConstruction offers workshops tested and practiced on global leaders in the construction industry to help your team navigate and leverage the power of data and artificial intelligence in your company's decision making.

    Reserve your spot now to rethink your
    approach to decision making!

     

    🚀 Welcome to the future of data in construction!

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    Have a question or need more information? Reach out to us directly!
    Schedule a time to discuss your needs with our team.
    Tailored sessions to help your team grow — let's plan together!
    Have you attended one of our workshops, read our book, or used our solutions? Share your thoughts with us!
    Name
    Data Maturity Diagnostics

    🧰 Data-Driven Readiness Check

    This short assessment will help you identify your company's data management pain points and offer solutions to improve project efficiency. It takes only 1–2 minutes to complete and you will receive personalized recommendations tailored to your needs.

    Clean & Organized Data

    Theoretical Chapters:

    Practical Chapters:

    What You'll Find on
    DDC Solutions:

    • CAD/BIM to spreadsheet/database converters (Revit, AutoCAD, IFC, Microstation)
    • Ready-to-deploy n8n workflows for construction processes
    • ETL pipelines for data synchronization between systems
    • Customizable Python scripts for repetitive tasks
    • Intelligent data validation and error detection
    • Real-time dashboard connectors
    • Automated reporting systems

    Connect Everything

    Theoretical Chapters:

    Practical Chapters:

    What You'll Find on
    DDC Solutions:

    • CAD/BIM to spreadsheet/database converters (Revit, AutoCAD, IFC, Microstation)
    • Ready-to-deploy n8n workflows for construction processes
    • ETL pipelines for data synchronization between systems
    • Customizable Python scripts for repetitive tasks
    • Intelligent data validation and error detection
    • Real-time dashboard connectors
    • Automated reporting systems

    Add AI & LLM Brain

    Theoretical Chapters:

    Practical Chapters:

    What You'll Find on
    DDC Solutions:

    • CAD/BIM to spreadsheet/database converters (Revit, AutoCAD, IFC, Microstation)
    • Ready-to-deploy n8n workflows for construction processes
    • ETL pipelines for data synchronization between systems
    • Customizable Python scripts for repetitive tasks
    • Intelligent data validation and error detection
    • Real-time dashboard connectors
    • Automated reporting systems
    New ETL concepts – AIA, BEP, IDS, LOD, COBie
    This website uses cookies to improve your experience. By using this website you agree to our Data Protection Policy.
    Read more
    ×