New dataset on EMI – Data on metering configurations

  • 13K Views
  • Last post 12 January 2023
Matthew Keir posted this 02 October 2016

Agents, third parties, and new entrant retailers have asked for information about metering configurations at ICPs throughout the country. These parties are investing in systems and processes, and it’s helpful for them to know all of the options up front rather than discovering each unique configuration one-by-one as they engage with consumers or use the ICP connection data API.

We’ve released a file detailing unique metering configurations at ICPs and the number of ICPs with each configuration. This information is provided at meter register level for any active meter in the registry at any installation at active ICPs. The register information is provided as a space delimited list with energy flow direction, register content code, and period of availability. More information can be found in the registry functional specification.

The file will be updated and released with other retail reports each month. As with all files in the datasets folders, they are also accessible via our FTP site.

  • Liked by
  • jofajafa
  • JessielGonzalez
Order by: Standard | Newest | Votes
jofajafa posted this 12 January 2023

Thanks Phil. I appreciate there is some work involved.

I would much prefer not to be making use of this data set but unfortunately the combinations of content codes and periods of availability present in the market keep proliferating. Within recent years the number of combinations was in the 80s, now there's well in excess of 100. Many of them used on just a few ICPs when an existing combination would be appropriate, so the optimal situation would be that there were principles and controls on what is implemented. Also are still some nonsense combinations being implemented, such as period of availability being zero, or 24 hours for a controlled register.

  • Liked by
  • msouness
Phil Bishop posted this 12 January 2023

Too much work to be done and not enough people to do it. There's about a week's work (for one person) required to rebuild the processing and publishing of this dataset. It was stopped when we finally pulled the plug on our old SQL Server instance almost a year ago. It remains on the TODO list to be restored. I will try to get it bumped up the priority ordering but can't make any promises as to when it will happen.

Phil. 

 

jofajafa posted this 11 January 2023

Hello EA team. There doesn't appear to have been any recent updates to this data; the file available to download is from April 2022.

This is disappointing as there are frequent additions to metering configurations (for example, I've noticed a lot of DIN and NIN new register types added in support of EV charging) that are difficult to track proactively. With a file like this, I have some ability to ensure pricing to meter configurations based on the registers in market. Without it, we often have to take a reactive approach to finding new registers on prospective customer sites.

Is there the potential for an updated file shortly?

Thanks

  • Liked by
  • msouness
msouness posted this 28 October 2019

Relocated meter register conversation to new discussion

 

  • Liked by
  • Matthew Keir
  • jofajafa
msouness posted this 01 October 2019

Great to see significant improvement of register content codes:

  56 I Flow non- EG (or 730x)

  374 I flow EG with less than 24h

  148 X flow EG24

  70 X flow non uncontrolled with 24h

  161 0h registers

However IN24 is still substantial at 316,902 registers.

  • Liked by
  • jofajafa
jofajafa posted this 20 June 2019

"Anyone have a good reason for the content code EG20 to be in Registry?"

It's disappointing that not only has the morass of legacy CC/POA combinations - many combinations of which as Malcolm has demonstrated are nonsensical - not been tidied up, but there apparently are no validation rules to limit the creation of new redundant combinations.

  • Liked by
  • msouness
msouness posted this 19 June 2019

Anyone have a good reason for the content code EG20 to be in Registry?  

msouness posted this 23 October 2018

Just been working through some serial number missmatches - found some Exponents. One MEP had three exponents as serial numbers, but are now fixed in registry.

Matthew Keir posted this 11 October 2018

Hi Malcolm,

Thanks for the note.

Just to be clear where this conversion issue is occurring - are you suggesting MEPs are populating the registry with serial numbers after opening in excel, and that what is causing this issue?

We're still pushing for improvements to reduce incompatible meter configuration information.

Matthew

 

 

 

  • Liked by
  • msouness
msouness posted this 11 October 2018

It may pay for some of the MEP's to take a look through their serial numbers to identify data type conversion to exponents due to excel's treatment of large integers.  

2.61E+11 (IN), 2.62E+11 (IN)

msouness posted this 24 August 2018

Interesting to see there are

138 residential ICPs with "X" flow EG meter registers

107 residential ICPs with "I" flow UN meter registers

 

 

Matthew Keir posted this 28 February 2018

Sorry - the heading I used may mean you missed it. See point two in the "Changes to datasets on EMI – NSP table, metering configurations, market structure and shape files" discussion.

msouness posted this 28 February 2018

- found it 

https://www.emi.ea.govt.nz/Retail/Datasets/MarketStructure/ICPandMeteringDetails

 

msouness posted this 28 February 2018

Hi Matt,

Is there a new location for the meter configuration dataset?

  • Liked by
  • jofajafa
Matthew Keir posted this 25 October 2017

Hi Clive,

Thank you for making us aware of this. The September files are now available.

We had a small issue occur in our data warehouse that happened to coincide with the automated processing that runs after the 10th business day each month. We hadn’t realised this had impacted any published files. This issue impacted all the monthly files published in retail datasets, not only the metering configurations file.

One of the reasons EMI exists is to support users to provide informed consultation responses. It’s great to hear that you’re making use of this information in this way.

To be clear, the files are published after the 10th business day - this is not always the 15th of each month.

Cheers,

Matthew

 

  • Liked by
  • jofajafa
  • Clive Gifford
Show more posts