Data Notification
Hierachy Changes and Data Additions
Notification - April 2004 -
Hierarchy Changes for PJM ISO Data
Background Information - Since 2000, LIM has carried real
time and day ahead locational marginal pricing (lmp) data, captured
from publicly accessible web sites. The data vendor (Pennsylvania
Jersey Maryland Independent System Operator) has provided daily
update files for the lmp's with hourly values for day ahead and real
time basis.
The lmp values were originally provided with information about the
zone and the node included in the description. Over time, the PJM
ISO provided different text descriptions of the zones, aggregates
and nodes depending on the internal system that was used to generate
the data at the particular point in history.
LIM attempted to organize the many thousands of lmp nodes and
aggregates by zone to make it easier for users to find what they
were looking for. However, the use of different abbreviations for
the zone names led to the creation of duplicate zones. Over time,
nodes were added with slightly different descriptions leading to
duplicate node symbols existing with "pockets" of historical data in
them.
New lmp nodes being added could not always be issued with MIM
symbols automatically because of ambiguity about which "zone" they
belonged to. Many aggregates were also not given a zone name in
their description. Latterly, PJM has been providing unique "pnodeID's"
for each lmp node and we have gone back through the history using
the unique pnode ID's to remove any duplicate node symbols.
Changes Made - The changes listed below were carried out by
LIM in order to re-organize the PJM lmp data in our server
hierarchies. Instead of using zones to organize the nodes and
aggregates, we simply used "node point" and "aggregate" as the data
categories.
Existing Hierarchy Locations - Lmp data is currently stored
in two separate categories, namely:
TopRelation:Energy:Electricity:Iso:Pjm:Day
AheadLmpData and
TopRelation:Energy:Electricity:Iso:Pjm:RealTimeLmpData
New Hierarchy Location - We will now store all PJM lmp data
under a single category folder:
TopRelation:Energy:Electricity:Iso:Pjm:LmpData
New Symbol Names - Zone information no longer part of
relation names, just in the descriptions when available.
New Symbol Name Fomat - No prefix, just a suffix - for
example
Old: PJM.NEWARKBAY.AGGREGATE.DA
New: NEWARKBAY.AGGREGATE.PJMDA
Data Categorized based on Node Name not Zone -
Old:
TR:Energy:Electricity:Iso:Pjm:DayAheadLmpData:Zone_AP:PJM.DALESUMM.230KV.T1.AP.DA
New:
TR:Energy:Electricity:Iso:Pjm:LmpData:DayAhead:
NodePoint:NodePoint_DEF: DALESUMM.230KV.T1.PJMDA
Note the following:
- Full automation of new relations as long as PJM provides the
Pnode ID.
- Duplicate relations have been merged.
Data has already been delivered to customers receiving the
current PJM data set so that customers now see both the old
hierarchy and the new.
Customer Rollout - Changes are already delivered and the
historical data has been reprocessed. We will give customers 3
months with the old data symbols to prepare to change to the new
symbols, before switching off the updates to the old symbols. The
cut-off date for the old data symbols is August 1,
2004.
If you have any questions about this intended change or its impact,
please contact our customer support desk at:
+1.800.546.9646 (U.S) or +44(0)207.553.2639 (Europe) or email:
support@lim.com.
Announcing Addition of US Geological Survey (USGS) Data
LIM is pleased to announce the addition of USGS mineral data to
our core data set. The US Geological Survey contains information
gathered by the Mineral Information Team, a group that "canvasses
the nonfuel mining and minerals processing industry in the US for
data on mineral production, consumption, stocks and shipments."
(Quote from the USGS website.)
For more information on the data, please see the
USGS website.
The data is located in the following path in the MIM hierarchy:
TopRelation:Indices:USGeologicalSurvey:Metals
Below is a complete list of the new MIM Symbols and Descriptions:
- USGS.PRIMARY.METALS.LEADNDX (MII Primary Metals Leading
Index)
- USGS.PRIMARY.METALS.COINNDX (MII Primary Metals
Coincident Index)
- USGS.COPPER.LEADNDX (MII Copper Leading Index)
- USGS.COPPER.COINNDX (MII Copper Coincident Index)
- USGS.STEEL.LEADNDX (MII Steel Leading Index)
- USGS.STEEL.COINNDX (MII Steel Coincident Index)
- USGS.METAL.PRICES.LEADNDX (MII Leading Index Metal
Prices)
- USGS.METAL.PRICES.NDXGRTHRATE (MII Nonferrous Metals
Price Index Growth Rate)
- USGS.METAL.PRODUCTS.INV (MII Us Nonferrous Metal
Products Inventories)
- USGS.METAL.PRODUCTS.INVGRTHRATE (MII Us Nonferrous
Metals Products Inventories Growth Rate)
Note: There is one column (implicit) associated with each data
symbol.
The USGS data set is scheduled to be loaded onto your MIM on
May 15, 2004.
Changes to Futures Hierarchy Structure
LIM will be changing the MIM hierarchy structure for futures data
to organize the futures data by exchange instead of by commodity.
Currently, futures data has the following organization in the MIM:
TopRelation:Futures:Currencies
TopRelation:Futures:ETFunds
TopRelation:Futures:Energy
TopRelation:Futures:Equitites
TopRelation:Futures:Financial
TopRelation:Futures:Foods
TopRelation:Futures:Grains
TopRelation:Futures:Industrials
TopRelation:Futures:Meats
TopRelation:Futures:Metals
TopRelation:Futures:MktIndices
TopRelation:Futures:Retired
TopRelation:Futures:options
Futures data will be organized by exchange:
TopRelation:Futures:EXCHANGENAME
For example, the symbol "NG" will move from:
TR:Futures:Energy:NG
to
TR:Futures:Nymex:NG
This change will take effect: June 1, 2004
Customers will not see any difference in symbols or columns, just
the parent change in the hierarchy. The only likely impact would be
if an XMIM query referred to the entire relation of the data in the
old category path or any sub branch of the data. If queries refer
directly to symbols, they will not be affected. If you have any
questions about this intended change or its impact, please contact
our customer support desk at: +1.800.546.9646 (U.S) or
+44(0)207.553.2639 (Europe) or email:
support@lim.com.
|
|