How Data is Generated and Shaped

Ciaran Rooney

Technology and Cybersecurity Leader

Discover how data is created, shaped, and transformed before it reaches your dashboard. Learn why definitions, proxies, and system design choices matter when interpreting data with confidence.

Data Science

Discover how data is created, shaped, and transformed before it reaches your dashboard. Learn why definitions, proxies, and system design choices matter when interpreting data with confidence.

Subscribe to watch

Access this and all of the content on our platform by signing up for a 7-day free trial.

How Data is Generated and Shaped

4 mins 28 secs

Key learning objectives:

Understand how data is generated through organisational processes
Recognise how early design choices shape what data represents
Identify key building blocks of data, including types, structure, and proxies
Understand how data changes as it moves from collection to insight

Overview:

Data is shaped long before it appears in dashboards. It enters organisations through everyday systems, reflecting choices about what is measured, how it is defined, and what is excluded. These early decisions influence what data can reveal and what it misses. Understanding how data is generated, structured, and transformed is essential to interpreting it correctly and avoiding false confidence.

Subscribe to watch

Access this and all of the content on our platform by signing up for a 7-day free trial.

Summary

How is data generated and why does it matter?

Data is created through systems such as transactions, surveys, logs, and manual input. These processes prioritise speed, cost, and practicality, meaning important context may be excluded. Early design choices determine what is captured and what is missed, shaping all downstream analysis.

What are the main types and structures of data?

Data can be quantitative (numbers) or qualitative (text, images, observations), and structured (organised into predefined formats) or unstructured (free-form). Structured data is easier to analyse, but may simplify reality, while unstructured data retains context but is often reduced during processing.

What are proxies and definitions, and how do they shape data?

When direct measurement is difficult, organisations rely on proxies and predefined classifications. These simplify complex concepts but can distort meaning if treated as exact representations. Definitions and sampling choices also determine what is included, affecting comparability and interpretation.

How does data change as it moves through systems?

Data passes through stages of collection, storage, analysis, and communication. At each step, it is filtered, aggregated, and interpreted. By the time it reaches a dashboard, it reflects multiple transformations, meaning the final output may differ significantly from the original data.

Subscribe to watch

Access this and all of the content on our platform by signing up for a 7-day free trial.

Ciaran Rooney

Ciarán is the Chief Technology Officer at xUnlocked. He has over 20 years of experience in technology, cyber security and operations. Ciarán has held the role of CTO of several successful startups including; busuu, Skimlinks, and Swoon. He has also been a technical consultant, a startup mentor, a conference speaker, and the Chair of the PHP UK Conference.

There are no available Videos from "Ciaran Rooney"