Data Set#

Dataset.Show

Overview#

A Data Set represents a collection of data in tabular format. Data Sets can be automatically created upon the creation of a new IoT Event Definition, or can be user-defined with a SELECT SQL statement. They can be used for many purposes, such as training ML models or feeding dashboards.

Data can also be accessed by any client supporting OData (example: Excel, PowerBI or Jupyter Notebook).

Folders#

If you navigate to the Data Sets page in the Data Platform menu, you can see that the Data Sets are organized into multiple root folders:

Each folder contains different types of Data Sets:

Apps - folder for data sets created and used by MES Apps.
CDM - folder for system data sets containing the Canonical Data Model data.
Datasilos - folder for Data Silos.
DWH - folder for Data Warehouse data sets containing aggregated data.
IoTEvents - folder for data sets associated with IoT Events.
MES - folder for data sets containing data from the ClickHouse MES database.
ODS - folder for data sets containing MES ODS data.
UserDefined - folder for data sets manually created by MES users.

The IoTEvents folder contains data sets that are automatically created when new IoT Event Definitions are created, and those data sets contain the flatted events being posted to Data Platform using those IoT Events.

Data sets that are created manually will go to the User Defined root folder, where you can also create sub-folders.

All other folders contain system data sets that contain MES data.

System Data Sets#

Here is the list of system data sets:

Warning

This list does not include all Data Sets that are available and created from each IoT Event Definition.

Name	Source	Folder	Scope
Area	CDM	`\Datasets\CDM`
AreaManufacturingDayShift	CDM	`\Datasets\CDM`
BaseData	ODS	`\Datasets\DWH\FutureFlowReport`
BulkBOMDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkChecklistDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkDataCollectionsDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkDocumentDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkDurableBOMDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkFutureActionDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkLineFlowDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkPartialResolveContexts	ODS	`\Datasets\DWH\FutureFlowReport`
BulkRecipeDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkReworkDetails	ODS	`\Datasets\DWH\FutureFlowReport`
BulkServiceResourceDetails	ODS	`\Datasets\DWH\FutureFlowReport`
CalendarDay (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Calendar`	DataPlatform
ConfigurationReportingResourceHistoryDefaultTimeframe	ODS	`\Datasets\DWH`
CostResolutions	ODS	`\Datasets\DWH`
DataCollectionInstances	CDM	`\Datasets\DWH`
DataCollectionReadings	CDM	`\Datasets\DWH`
DeviceBinCodeHistory	MES	`\Datasets\MES`
DeviceTraceability	MES	`\Datasets\MES`
Enterprise	CDM	`\Datasets\CDM`
Facility	CDM	`\Datasets\CDM`
FlowItems	ODS	`\Datasets\DWH`
FlowStructure	ODS	`\Datasets\DWH\FutureFlowReport`
FutureMaterialMovement (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Material`	DataPlatform
HoldRelease (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Material`	DataPlatform
InProcessVerification	ODS	`\Datasets\DWH`
LossBonus (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Material`	DataPlatform
MaintenanceActivityOrderQualificationCheck	ODS	`\Datasets\DWH`
MaintenanceActivityOrderQualificationCheckVerification	ODS	`\Datasets\DWH`
MaintenanceActivityOrderQualificationItem	ODS	`\Datasets\DWH`
MaintenanceOrder	CDM	`\Datasets\CDM`
MaintenanceOrder (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Maintenance`	DataPlatform
MaintenanceOrderChecklists	ODS	`\Datasets\DWH`
MaintenanceOrderComments	ODS	`\Datasets\DWH`
MaintenanceOrderDataCollections	ODS	`\Datasets\DWH`
MaintenanceOrderHistory	CDM	`\Datasets\CDM`
MaintenanceOrderMaterials	ODS	`\Datasets\DWH`
MaintenanceOrderParts	ODS	`\Datasets\DWH`
MaintenanceOrderPersonnel	ODS	`\Datasets\DWH`
MaintenanceOrderResourceOperations	ODS	`\Datasets\DWH`
MaintenanceOrderState	CDM	`\Datasets\DWH`
MaterialAssemble	ODS	`\Datasets\DWH`
MaterialAttachments	ODS	`\Datasets\DWH`
MaterialAttributes	CDM	`\Datasets\DWH`
MaterialChecklistBOMItemMaterials	ODS	`\Datasets\DWH`
MaterialChecklistInstanceBOMItems	ODS	`\Datasets\DWH`
MaterialChecklistItemDataCollectionPoints	ODS	`\Datasets\DWH`
MaterialChecklistItemInstanceParameters	ODS	`\Datasets\DWH`
MaterialChecklistItems	ODS	`\Datasets\DWH`
MaterialChecklists	ODS	`\Datasets\DWH`
MaterialContainerTracking	ODS	`\Datasets\DWH`
MaterialCostInfo	ODS	`\Datasets\DWH`
MaterialDefects (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Material`	DataPlatform
MaterialDefectsState	CDM	`\Datasets\CDM`
MaterialGenealogy (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Material`	DataPlatform
MaterialGenealogyExpanded	CDM	`\Datasets\CDM`
MaterialInventory	DWH	`\Datasets\CDM`
MaterialLabelsAndLotTravelers	ODS	`\Datasets\DWH`
MaterialLabelsAndLotTravelersDataContexts	ODS	`\Datasets\DWH`
MaterialLossBonus	DWH	`\Datasets\DWH`
MaterialLossHistory	CDM	`\Datasets\CDM`
MaterialMovement	DWH	`\Datasets\CDM`
MaterialMovementCost	CDM	`\Datasets\CDM`
MaterialMovementPerStep	DWH	`\Datasets\CDM\Material`
MaterialMovementShifts	DWH	`\Datasets\CDM`
MaterialOperations (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Material`	DataPlatform
MaterialProductionOrderChanges	CDM	`\Datasets\CDM`
MaterialProtocols	ODS	`\Datasets\DWH`
MaterialRecipeInstanceParameters	ODS	`\Datasets\DWH`
MaterialRecipeInstances	ODS	`\Datasets\DWH`
MaterialServices	CDM	`\Datasets\DWH`
MaterialTools	CDM	`\Datasets\DWH`
MaterialTopMostRecipeInstances	ODS	`\Datasets\DWH`
Package	ODS	`\Datasets\DWH`
PackageContents	ODS	`\Datasets\DWH`
PendingLateProductionOrders	CDM	`\Datasets\DWH`
PeriodicInventory	ODS	`\Datasets\DWH`
PeriodicInventoryMaterials	ODS	`\Datasets\DWH`
PickList	ODS	`\Datasets\DWH`
PickListItems	ODS	`\Datasets\DWH`
PostDataCollection (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions`	DataPlatform
PostMeasurement (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions`	DataPlatform
PostTelemetry (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions`	DataPlatform
ProductCostInfo	ODS	`\Datasets\DWH`
ProductGroupProductionMonitoring	DWH	`\Datasets\CDM`
ProductionCycleTimes (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Production`	DataPlatform
ProductionMonitoringPerShift	DWH	`\Datasets\CDM`
ProductionMonitoringVariables	DWH	`\Datasets\CDM`
ProductionOrder (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Production`	DataPlatform
ProductionOrdersInProgress	CDM	`\Datasets\DWH`
ProductionPlans (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Production`	DataPlatform
ProductProductionMonitoring	DWH	`\Datasets\CDM`
ProtocolInstance (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Quality`	DataPlatform
ProtocolInstanceDocuments	ODS	`\Datasets\DWH`
ProtocolInstanceMaterials	ODS	`\Datasets\DWH`
ProtocolInstanceStateChecklist	ODS	`\Datasets\DWH`
ProtocolInstanceStateChecklistItemParameters	ODS	`\Datasets\DWH`
ProtocolInstanceStateChecklistItems	ODS	`\Datasets\DWH`
ProtocolInstanceStateParameters	ODS	`\Datasets\DWH`
ProtocolInstanceStates	ODS	`\Datasets\DWH`
ProtocolInstanceTasks	ODS	`\Datasets\DWH`
Resource	CDM	`\Datasets\CDM`
ResourceAlarm	CDM	`\Datasets\CDM`
ResourceAlarm (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Resource`	DataPlatform
ResourceHistory	CDM	`\Datasets\CDM`
ResourceLayout (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Resource`	DataPlatform
ResourceStateChange (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Resource`	DataPlatform
ResourceStates	DWH	`\Datasets\CDM`
ResourceStatesNonWorkingTimes	DWH	`\Datasets\CDM`
ResourceTimeAtState	CDM	`\Datasets\CDM`
ShipOutDate	DWH	`\Datasets\CDM`
ShipUnship (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Material`	DataPlatform
Site	CDM	`\Datasets\CDM`
StepCostInfo	ODS	`\Datasets\DWH`
TransferOrder	ODS	`\Datasets\DWH`
TransferOrderItems	ODS	`\Datasets\DWH`
TransferRequirement	ODS	`\Datasets\DWH`
TransferRequirementItems	ODS	`\Datasets\DWH`
UnitConversionFactors (IoT Event Definition)	IoT Event Definition	`\IoTEventDefinitions\CDM\Production`	DataPlatform
WIPHistory	DWH	`\Datasets\CDM`
WIPView	DWH	`\Datasets\DWH`

Table: System DataSets