The problem of closed and proprietary data
22 February 2024
The problem of number and variation of business cases in construction
22 February 2024

The problem of data heterogeneity

Today, we rely on ERP, CAD (BIM), EMP or cloud corporations to store our data when exchanging data between different systems. To maintain their influence on the construction industry, corporations that do not benefit from data transparency and interoperability have monopolized data storage and processing.

The proprietary nature of systems results in each program having its own unique format that is either closed and inaccessible from the outside - RVT, PLN, DWG, NDW, NWD, SKP or available in a semi-structured (and often mixed) form - JSON, XML, CPIXML, IFC, STEP and ifcXML, IfcJSON, IfcSQL, RDF, dotBIM, BIMJSON. These various data formats not only differ in structure, but also include different versions of internal markup that developers need to understand in order to create interoperability between applications that work with these formats.

Without giving access to databases directly, each software vendor in the construction industry invents its own “bicycle”, which must be used by a specialist to import and export data.

As a consequence, vendors of basic CAD (BIM) and ERP solutions are constantly raising prices for using their products, and ordinary users are forced to pay a "commission" at every stage of data transfer in 3D-8D systems: for connecting, importing, exporting and working with data that users have created themselves. The cost of accessing data in cloud storage from popular CAD (BIM) products in 2024 reaches $1 per transaction, and subscriptions to ERP products for medium-sized companies reach hundreds of thousands of dollars per year.

The point of today's software zoo is that it is not automation or efficiency gains - but the skill of engineers in their knowledge of specific highly specialised software, that affects the quality and cost of a construction project, and the profit and long term survival of construction companies.

The lack of open data in the process of creating a puzzle of closed system solutions and the resulting lack of quality communication between individual specialists has led the construction industry to the status of one of the most inefficient sectors of the economy in terms of productivity.

Over the last 20 years of application of CAD (BIM) design, the emergence of new systems (ERP), construction technologies and materials, the productivity of the entire construction industry has fallen by 20%, while the overall productivity of all sectors of the economy has increased by 70% (96% in the manufacturing industry).

Due to the limitations of closed systems and differences in data formats, as well as the lack of effective tools for their unification, companies face the accumulation of significant amounts of data of different degrees of structure. These data are not properly utilized and are transferred to archives, where over time they remain forever forgotten and unused.

Data obtained through considerable effort, due to its complexity, makes it unavailable for future use. This will continue until there is a specialized tool or enthusiast willing to tackle the daunting task of retrieving and using this once lost data.

An additional cause of productivity stagnation in the construction industry is not only the lack of process transparency, which benefits all participants in construction except the client and the customer, but also the variability and changeability of tasks faced by all participants in the processes.

Leave a Reply

Change language

Post's Highlights

    Stay updated: news and insights



    We’re Here to Help

    Fresh solutions are released through our social channels

    UNLOCK THE POWER OF DATA
     IN CONSTRUCTION

    Dive into the world of data-driven construction with this accessible guide, perfect for professionals and novices alike.
    From the basics of data management to cutting-edge trends in digital transformation, this book
    will be your comprehensive guide to using data in the construction industry.

    Related posts 

    Focus Areas

    navigate
    • ALL THE CHAPTERS IN THIS PART
    • A PRACTICAL GUIDE TO IMPLEMENTING A DATA-DRIVEN APPROACH (8)
    • CLASSIFICATION AND INTEGRATION: A COMMON LANGUAGE FOR CONSTRUCTION DATA (8)
    • DATA FLOW WITHOUT MANUAL EFFORT: WHY ETL (8)
    • DATA INFRASTRUCTURE: FROM STORAGE FORMATS TO DIGITAL REPOSITORIES (8)
    • DATA UNIFICATION AND STRUCTURING (7)
    • SYSTEMATIZATION OF REQUIREMENTS AND VALIDATION OF INFORMATION (7)
    • COST CALCULATIONS AND ESTIMATES FOR CONSTRUCTION PROJECTS (6)
    • EMERGENCE OF BIM-CONCEPTS IN THE CONSTRUCTION INDUSTRY (6)
    • MACHINE LEARNING AND PREDICTIONS (6)
    • BIG DATA AND ITS ANALYSIS (5)
    • DATA ANALYTICS AND DATA-DRIVEN DECISION-MAKING (5)
    • DATA CONVERSION INTO A STRUCTURED FORM (5)
    • DESIGN PARAMETERIZATION AND USE OF LLM FOR CAD OPERATION (5)
    • GEOMETRY IN CONSTRUCTION: FROM LINES TO CUBIC METERS (5)
    • LLM AND THEIR ROLE IN DATA PROCESSING AND BUSINESS PROCESSES (5)
    • ORCHESTRATION OF ETL AND WORKFLOWS: PRACTICAL SOLUTIONS (5)
    • SURVIVAL STRATEGIES: BUILDING COMPETITIVE ADVANTAGE (5)
    • 4D-6D and Calculation of Carbon Dioxide Emissions (4)
    • CONSTRUCTION ERP AND PMIS SYSTEMS (4)
    • COST AND SCHEDULE FORECASTING USING MACHINE LEARNING (4)
    • DATA WAREHOUSE MANAGEMENT AND CHAOS PREVENTION (4)
    • EVOLUTION OF DATA USE IN THE CONSTRUCTION INDUSTRY (4)
    • IDE WITH LLM SUPPORT AND FUTURE PROGRAMMING CHANGES (4)
    • QUANTITY TAKE-OFF AND AUTOMATIC CREATION OF ESTIMATES AND SCHEDULES (4)
    • THE DIGITAL REVOLUTION AND THE EXPLOSION OF DATA (4)
    • Uncategorized (4)
    • CLOSED PROJECT FORMATS AND INTEROPERABILITY ISSUES (3)
    • MANAGEMENT SYSTEMS IN CONSTRUCTION (3)
    • AUTOMATIC ETL CONVEYOR (PIPELINE) (2)

    Search

    Search

    057 Speed of decision making depends on data quality

    Today’s design data architecture is undergoing fundamental changes. The industry is moving away from bulky, isolated models and closed formats towards more flexible, machine-readable structures focused on analytics, integration and process automation. However, the transition...

    060 A common language of construction the role of classifiers in digital transformation

    In the context of digitalization and automation of inspection and processing processes, a special role is played by classification systems elements – a kind of “digital dictionaries” that ensure uniformity in the description and parameterization...

    061 Masterformat, OmniClass, Uniclass and CoClass the evolution of classification systems

    Historically, construction element and work classifiers have evolved in three generations, each reflecting the level of available technology and the current needs of the industry in a particular time period (Fig. 4.2-8): First generation (early...

    Don't miss the new solutions

     

     

    Linux

    macOS

    Looking for the Linux or MAC version? Send us a quick message using the button below, and we’ll guide you through the process!


    📥 Download OnePager

    Welcome to DataDrivenConstruction—where data meets innovation in the construction industry. Our One-Pager offers a concise overview of how our data-driven solutions can transform your projects, enhance efficiency, and drive sustainable growth. 

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DDC terms of use 

    🚀 Welcome to the future of data in construction!

    You're taking your first step into the world of open data, working with normalized, structured data—the foundation of data analytics and modern automation tools.

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    DataDrivenConstruction offers workshops tested and practiced on global leaders in the construction industry to help your team navigate and leverage the power of data and artificial intelligence in your company's decision making.

    Reserve your spot now to rethink your
    approach to decision making!

     

    🚀 Welcome to the future of data in construction!

    By downloading, you agree to the DataDrivenConstruction terms of use 

    Stay ahead with the latest updates on converters, tools, AI, LLM
    and data analytics in construction — Subscribe now!

    Have a question or need more information? Reach out to us directly!
    Schedule a time to discuss your needs with our team.
    Tailored sessions to help your team grow — let's plan together!
    Have you attended one of our workshops, read our book, or used our solutions? Share your thoughts with us!
    Name
    Data Maturity Diagnostics

    🧰 Data-Driven Readiness Check

    This short assessment will help you identify your company's data management pain points and offer solutions to improve project efficiency. It takes only 1–2 minutes to complete and you will receive personalized recommendations tailored to your needs.

    Clean & Organized Data

    Theoretical Chapters:

    Practical Chapters:

    What You'll Find on
    DDC Solutions:

    • CAD/BIM to spreadsheet/database converters (Revit, AutoCAD, IFC, Microstation)
    • Ready-to-deploy n8n workflows for construction processes
    • ETL pipelines for data synchronization between systems
    • Customizable Python scripts for repetitive tasks
    • Intelligent data validation and error detection
    • Real-time dashboard connectors
    • Automated reporting systems

    Connect Everything

    Theoretical Chapters:

    Practical Chapters:

    What You'll Find on
    DDC Solutions:

    • CAD/BIM to spreadsheet/database converters (Revit, AutoCAD, IFC, Microstation)
    • Ready-to-deploy n8n workflows for construction processes
    • ETL pipelines for data synchronization between systems
    • Customizable Python scripts for repetitive tasks
    • Intelligent data validation and error detection
    • Real-time dashboard connectors
    • Automated reporting systems

    Add AI & LLM Brain

    Theoretical Chapters:

    Practical Chapters:

    What You'll Find on
    DDC Solutions:

    • CAD/BIM to spreadsheet/database converters (Revit, AutoCAD, IFC, Microstation)
    • Ready-to-deploy n8n workflows for construction processes
    • ETL pipelines for data synchronization between systems
    • Customizable Python scripts for repetitive tasks
    • Intelligent data validation and error detection
    • Real-time dashboard connectors
    • Automated reporting systems
    The problem of data heterogeneity
    This website uses cookies to improve your experience. By using this website you agree to our Data Protection Policy.
    Read more
    ×