Scr 727 esiid service History & Usage Extract Documentation



Yüklə 135.28 Kb.
səhifə1/7
tarix14.04.2016
ölçüsü135.28 Kb.
  1   2   3   4   5   6   7

SCR 727 ESIID Service History & Usage Extract Documentation







SCR 727 ESIID Service History & Usage Extract
Business User’s Guide and

Technical Data Loading Guide

Updated 12/1/2008




Document Summary 4

Introduction 4

General Information 4

Market Data Transparency Web Services (ESIID) 4

Data Extract Transition Process 5

Getting Started 6

About ERCOT Data Extracts 6

Data Definition Language (DDL) Files 6

Creating the Database Structure 7

Keeping Your Data Current 7

Applying Changes to the Database Structure 7

Receiving Data: Overview 8

Extract Data Tables 8

Data Extract File Delivery- 9

Data File Naming Conventions 9

Loading Scheduled Extract Data 9

Example: Loading data using SQL*Loader 10

Example: PL/SQL procedure to load table from the “staging” area into the “work” area 10

What to know about the data 11

Dimensional Data Table Contents 11

Dimensional Data Table Add times 11

ESIID Level Data Table Contents 12

ESIID Level Data Table Add times 12

“Delete” Table Processing 12



Handling Exceptions 14

Appendix A: Table Order for Daily Loading 14

Appendix B: Data Field Descriptions By Table 15

Dimensional Tables- 15

MRE 15


PGC 15

PROFILECLASS 15

REP 17

STATION 17



STATIONSERVICEHIST 17

TDSP 17


Transactional Tables- 18

ESIID 18


ESIIDSERVICEHIST 18

ESIIDSERVICEHIST_DELETE 19

ESIIDUSAGE 19

ESIIDUSAGE_DELETE 20

LSCHANNELCUTHEADER 20

LSCHANNELCUTHEADER_DELETE 21



LSCHANNELCUTDATA 21

Appendix C: SCR727 Lodestar Database Schema 22


Document Summary

Introduction


This document describes the data contained within and the environment and strategies for data loading the SCR 727 ESIID Service History & Usage Extract data. Explanation on how the extract is built and the data that is contained on a daily basis is provided. The technical examples contained in this document use Oracle architecture. The concepts, however, can be applied to any relational database system (RDBS) with adjustments.
This document is intended for both business and technical audiences. This guide is not intended as a complete guide for scheduled data extracts. Supplemental information regarding the SCR 727 ESIID Service History & Usage Extract will be communicated to the market from ERCOT on an as needed basis. Please ensure that these communications are passed within your organization to the appropriate parties responsible for the business and technical aspects of processing ESIID Service History & Usage Extract data.
When translating the logic within this document to your own systems, please be aware that the examples may need modifications in order to accommodate your unique environment. Thorough testing is strongly advised.

General Information


This extract:

    • Provides transparency to Market Participants for ESIID level data that ERCOT utilizes in market settlement

    • Provides data for Market Participants to perform comparisons for identifying ESIID relationships, characteristics and usage and generation variances between their internal systems and ERCOT systems

    • Provides necessary data for LSEs to shadow settle their load volume

    • Provides the level of transparency to expedite resolution of ESIID level data anomalies between ERCOT and Market Participant systems, which should result in greater accuracy of settlement statements

    • Is triggered by data inserts/updates/deletes occurring within the data load time window

Who receives this extract?

    • LSEs, TDSPs/MREs

    • Extract is scheduled by Market Participants

Market Data Transparency Web Services (ESIID)


A new set of Market Data Transparency Web Services will be delivered to the market with the implementation of SCR 740 (SCR 727 Phase II). Market Participants will be able to use these Web Services to perform ad-hoc data research on ESIID information used during the data aggregation and settlements processes. Market Participants will also be able to request a database refresh for their SCR 727 ESIID Service History & Usage Extract databases. The refresh is requested based on a provided point in time. Once the refresh data is loaded in the Market Participant database, the subsequent day’s daily SCR 727 ESIID Service History & Usage Extract should be applied while continuing to load daily files to keep the data current.


Data Extract Transition Process


This section describes the transition process that will be used when the SCR 727 ESIID Service History & Usage extract is moved from production out of the Data Archive to the Lodestar ODS. A diagram explaining the SCR 727 transition process is displayed below along with a list of significant information of changes to the extract.

NOTE: This transition plan only applies to recipients of the extract at the time of the transition.






  1. Extract data load window is changing from receiving an extract file, including the net change of data for trunc(SYSDATE – 1) 04:00:00 – trunc(SYSDATE) 04:00:00, to receiving an extract file including the net change of data for trunc(SYSDATE -3) batch date. This data will be representative of the data available for use in the data aggregation and settlements process for trunc(SYSDATE – 3) batch date.

  2. This transition does not require any changes to the DDL.

  3. ESIID Usage & Service History daily extracts will transition by using a two day window to synchronize the production of the extract with the batch loading cycle as shown in the diagram above.

  4. The transition process will not incur a data gap as the result of transitioning to the new method of production.

  5. A single day of the extract (batch day 1/19/2007 in the example) will have a shortened load window to align with the new schedule and possibly contain fewer rows of transactional data.

  6. At the time of the transition, all current recipients of the SCR 727 extract will continue to receive the extract moving from the old schedule to the new schedule. This will not require actions by the Market Participants.

  7. Market Participants scheduled to receive the extract will have the capability to unschedule themselves from receiving the daily SCR 727 data extracts once this transition is complete.

  8. Any Market Participants who are not in ERCOT systems at the time of the transition will not be scheduled to receive extracts on a daily basis.

  9. Market Participants not opted-in, or those that have unscheduled data extracts, will need to request an initial data refresh to baseline their SCR 727 ESIID Service History & Usage Extract database in addition to submitting an opt-in to receive daily extracts. The request for an initial data refresh should be for a point in time of sysdate-1, while the request for the daily extracts should occur on the same day as the request is made for the database refresh. These requests should be performed simultaneously so that there are no lapses in data delivery.

  10. TDSPs will no longer receive separate TDSP and MRE extracts. One extract per Market Participant DUNs number will be created going forward. TDSPs that are only MREs for certain ESIIDs will now receive a combined data file which includes ESIIDs for which they are the TDSP and/or MRE.





Yüklə 135.28 Kb.

Dostları ilə paylaş:
  1   2   3   4   5   6   7



Verilənlər bazası müəlliflik hüququ ilə müdafiə olunur ©azrefs.org 2020
rəhbərliyinə müraciət
gir | qeydiyyatdan keç
    Ana səhifə
Dərs
Guide
Instructions
Mühazirə
Qaydalar
Qualifications
Referat
Report
Request
Review
Xülasə

yükləyin