Event Data: A Challenge and Opportunity
Virtually every form of information technology produces event data. Sometimes referred to as log data, audit trails or the system of record, event data is a set of chronologically sequenced data records that capture information about what happens in the digital infrastructure.
Event Data is Different from Transactional Data in Traditional Data Warehouses
-
Cumulative volume. Event data accumulates rapidly and often must be stored for years; many organizations are managing hundreds of terabytes and some are managing petabytes.
-
Format. Because of the huge variety of sources, event data is unstructured and semistructured.
-
Collection. Event data is difficult to collect because of broadly dispersed systems and networks.
-
Time-stamped. Event data is always inserted once with a time-stamp. It never changes.
Event Data Sources
-
Network and security devices
-
Physical access systems
-
Identity management systems
-
Workstations, servers, and operating systems
-
Database activity
-
Enterprise applications, including shrink-wrapped, customized, and homegrown
-
Banking transactions such as online, ATM, and debit card use
-
Historical prices of stocks and other instruments
-
Telco call detail records (CDRs)
-
Internet protocol detail records (IPDRs) of web-based access and transactions
-
Updates to shipping status in RFID records
-
Email, Windows, network, and other systems management activity events
-
Manufacturing sensor data
For a full list of Sensage data sources and log adaptors, click here.
