10 June 2025
Apache Airflow is widely used to organize complex data processing processes, allowing to build flexible ETL -conveyors. Apache Airflow can be run either through a web […]
- All
- 3D Printing and Rendering
- 4D-6D and Calculation of Carbon Dioxide Emissions
- 4D, 6D-8D AND CALCULATION OF CO2 CARBON EMISSIONS
- A PRACTICAL GUIDE TO IMPLEMENTING A DATA-DRIVEN APPROACH
- AUTOMATIC ETL CONVEYOR (PIPELINE)
- AUTOMATIC PIPELINE- ETL DATA VALIDATION
- Big Data
- BIG DATA AND ITS ANALYSIS
- Blog
- CHALLENGES IN WORKING WITH DATA IN THE CONSTRUCTION INDUSTRY
- CLASSIFICATION AND INTEGRATION: A COMMON LANGUAGE FOR CONSTRUCTION DATA
- CLOSED PROJECT FORMATS AND INTEROPERABILITY ISSUES
- CONSTRUCTION ERP
- CONSTRUCTION ERP AND PMIS SYSTEMS
- CONSTRUCTION PROJECT COSTINGS AND ESTIMATES
- COST AND SCHEDULE FORECASTING USING MACHINE LEARNING
- COST CALCULATIONS AND ESTIMATES FOR CONSTRUCTION PROJECTS
- Dashboard and Data Visualization
- DATA ANALYTICS AND DATA-DRIVEN DECISION-MAKING
- DATA ANALYTICS AND DECISION-MAKING PROCESS
- Data Conversion
- DATA CONVERSION INTO A STRUCTURED FORM
- DATA FLOW WITHOUT MANUAL EFFORT: WHY ETL
- DATA FRAGMENTATION AND SILOS
- DATA INFRASTRUCTURE: FROM STORAGE FORMATS TO DIGITAL REPOSITORIES
- Data Management
- DATA MODELLING AND THE EMERGENCE OF STANDARDS
- Data Processing and Export
- DATA QUALITY REQUIREMENTS AND ASSURANCE
- DATA TYPES IN CONSTRUCTION
- DATA UNIFICATION AND STRUCTURING
- DATA WAREHOUSE MANAGEMENT AND CHAOS PREVENTION
- DATA-DRIVEN ESTIMATING AND QUANTITY TAKE-OFFS
- DataDrivenConstruction
- DESIGN PARAMETERIZATION AND USE OF LLM FOR CAD OPERATION
- EMERGENCE OF BIM-CONCEPTS IN THE CONSTRUCTION INDUSTRY
- Estimation and Scheduling
- ETL AND PROCESS AUTOMATION
- EVOLUTION OF DATA USE IN THE CONSTRUCTION INDUSTRY
- EVOLUTION OF THE USE OF DATA IN THE CONSTRUCTION INDUSTRY
- GEOMETRY IN CONSTRUCTION: FROM LINES TO CUBIC METERS
- Groupings and filtering
- IDE WITH LLM SUPPORT AND FUTURE PROGRAMMING CHANGES
- LLM AND THEIR ROLE IN DATA PROCESSING AND BUSINESS PROCESSES
- MACHINE LEARNING AND PREDICTIONS
- Main Page
- MANAGEMENT SYSTEMS IN CONSTRUCTION
- MODERN DATA TECHNOLOGIES IN THE CONSTRUCTION INDUSTRY
- News & Blog
- OPEN DATA DOMINANCE
- ORCHESTRATION OF ETL AND WORKFLOWS: PRACTICAL SOLUTIONS
- PANDAS DATAFRAME AND LLM CHATGPT
- PART 1. FROM CLAY TABLETS TO THE DIGITAL REVOLUTION: HOW INFORMATION HAS EVOLVED IN CONSTRUCTION
- PART 10. THE CONSTRUCTION INDUSTRY IN THE DIGITAL AGE. OPPORTUNITIES AND CHALLENGES
- PART 2. HOW THE CONSTRUCTION BUSINESS IS DROWNING IN DATA CHAOS
- PART 3. DATA FRAMEWORK IN CONSTRUCTION BUSINESS PROCESSES
- PART 4. DATA QUALITY: ORGANIZATION
- PART 5. COST AND TIME CALCULATIONS: INCORPORATING DATA INTO CONSTRUCTION PROCESSES
- PART 6. CAD AND BIM: MARKETING
- PART 7. DATA-DRIVEN DECISION-MAKING
- PART 8. DATA STORAGE AND MANAGEMENT IN CONSTRUCTION
- PART 9. BIG DATA
- Pipelines
- Process Automation
- Project Management
- Quality Control
- QUANTITY TAKE-OFF AND AUTOMATIC CREATION OF ESTIMATES AND SCHEDULES
- Revit and IFC
- Software Integration
- SURVIVAL STRATEGIES: BUILDING COMPETITIVE ADVANTAGE
- SYSTEMATIZATION OF REQUIREMENTS AND VALIDATION OF INFORMATION
- THE DIGITAL REVOLUTION AND THE EXPLOSION OF DATA
- THE FUTURE: PREDICTIONS, FORECASTS AND MACHINE LEARNING
- TRANSFORMING DATA INTO STRUCTURED FORM
- TURNING CHAOS INTO ORDER AND REDUCING COMPLEXITY
- Uncategorized
10 June 2025
Storage formats play a key role in the scalability, reliability, and performance of analytics infrastructure. For data analysis and processing – such as filtering, grouping, and […]
10 June 2025
One of the popular formats for storing and processing big data is Apache Parquet. This format is designed specifically for columnar storage (similar to Pandas), which […]
10 June 2025
Vector databases are a new class of repositories that do not just store data, but allow searching by meaning, comparing objects by semantic proximity, and creating […]
10 June 2025
The term “big data” does not have a strict definition. The concept originally appeared when the volume of information began to exceed the capabilities of traditional […]
10 June 2025
Working with open datasets provides a unique opportunity to put into practice the principles discussed in previous chapters: judicious feature selection, representative sampling, visualization, and critical […]
10 June 2025
In the following example we will analyze a large dataset using data from different CAD tools (BIM). To collect and create the large dataset, a specialized […]
10 June 2025
In this chapter, we look at the digital transformation roadmap and identify the key steps required to implement a data-driven approach that can help transform both […]
