r/homeautomation • • 12h ago

PERSONAL SETUP 60 channels of per-breaker energy monitoring, at the finish line.

Since, I have this odd obsession with monitoring and tracking energy data....

I have been busy working on a solution to monitor, ALL of the energy. Not some of the energy, but, ALL of the energy.

I initially was using CT Clamps, however, this gets very messy, and the quantity of cables becomes a problem. I ended up finding some 20 conductor cable, which has been working perfectly for this task, allowing me to monitor the 30 slot panel on the left, with only 4 total cables, and a single cable for the right panel which only contains 6x 240v loads.

The star of the show is the KinCony N30, running ESPHome. Yes... I should have picked up the N60. But- I didn't know I would be using 60 channels until it happened. So, instead I have a pair of N30s.

All of the data collected is fed into..... home assistant, MQTT, prometheus, emoncms, and my software, rpdu2mqtt (It originally just monitored my PDUs).

I have been COMPLETELY ripping out and replacing all of the energy infrastructure at this house which I moved into last winter... This is due to the solar build out I have been working on. My goals have been to more or less, eliminate having an electric bill.

Since, I am cheap, I have done 100% of the work myself. Trenching, Welding, Construction, Electrical, Plumbing... All of it.

As of this month, It is currently hitting 90% of my net usage, which is fantastic. But, I have another dozen or so panels to install to get this number boosted up a bit. Right now, HVAC needs are at the lowest time of the year. During the summer.... Significantly more energy is required here.

Suppose- thats all. Just sharing my project.

Edit- minor detail- but, all of the voltage references, and CT cables are phase-marked with heat shrinking. Split phase- so, not actually a phase- but, Do have to ensure breakers are correctly aligned to the correct pole/voltage sensor.

162 Upvotes

66 comments sorted by

56

u/Hotfield 12h ago edited 10h ago

I love it when people just go that tiny bit too far, shows passion!

Very neat! Nicely done

9

u/HTTP_404_NotFound 11h ago

Thanks, appreciate it! I have been putting many hours into this project since the start of June. Its, been a big one.

14

u/HTTP_404_NotFound 11h ago

Oh, forgot one cool part of the project-

I am also PHYSICALLY mapping out all of the circuits in this house... and GFCIs.

There is some questionable wiring here... but, thanks to having all of the CTs, I can literally walk around with a 1,800w heat gun, and very quickly map outlets back to circuits....

Useful for finding problems such as.......

  1. Microwave is on the same circuit as the lights.

  2. Middle bathroom is on same circuit as master bedroom (and is not GFCI protected).

  3. Middle bedroom, has a random outlet that is shared with the livingroom, oddly.

  4. The livingroom has a different breaker for every wall nearly.......

5

u/shbatm 9h ago

What are you using for the floor plan above?

7

u/HTTP_404_NotFound 7h ago

https://xtremeownage.github.io/rPDU2MQTT/energy-flow/floor-plans/

Same software I created, which is collecting everything else, handles the floor plans too.

•

u/QuitCallingNewsrooms 28m ago

This. This is the part that makes me want to do a project like this at my mom's house. There are so many outlets and switches that make no sense in her little 3bed-2bath 1300-sqft house. There's a switch that turns off the outlets on one wall in the living room.

9

u/szonce1 12h ago

Very nice. I monitor all mine also. One project that really saved me on energy is my hvac. It’s a heat pump and has an api. So naturally I made a project for it. Shelly BT sensors on all doors and windows. If one is open for more than 2 min, it shuts off the hvac system.

9

u/HTTP_404_NotFound 11h ago

I've noticed from the data- my deep freezer apparently either needs to get cleaned out, or...... its going out on me.

Its also saved me before from the fridge/freezer going out.

100% on HVAC, I have three minisplits, a central 5-ton unit, and.... a fireplace. This data does help me with a few things. It helps me identify rooms/areas which have more leakage then expected... and.. well. Its extremely handy to be able to track the hvac usage across the handful of units.

16

u/Judman13 12h ago

What ct's are you using and what is their accurac?  Is the multi conductor cable twisted pair to reduce electrical crosstalk? 

16

u/HTTP_404_NotFound 11h ago

Nothing fancy on the CTs-

https://www.aliexpress.us/item/3256801898427354.html https://www.aliexpress.us/item/3256804073775017.html

They, are accurate enough I don't see large discrepancies when comparing the children CTs to the parent CTs (which were not cheap!)

The cable is NOT twisted-pair. But, I am not concerned with this as its reading mA, rather then frequency, etc from the clamps.

I've been testing it for a good week now, and everything is looking, as I would expect.

3

u/ReadyNeck3258 7h ago

Did you use the same maximum current rates CTs on all circuits? My led light circuits or fridge circuit will pull a few amps where as my EV charger or induction cooktop (or hot water unit) will pull 32A. My instinct is to size the CT to just above the breaker rating. Is the added complexity justified, or did you just use the same CT on all?

2

u/HTTP_404_NotFound 7h ago

The smaller CTs I linked are rated up to 40A maximum, I used those for all of the 20A circuits.

The bigger ones are rated up to 60A, I used those for all of the 30/40/50/60A breakers.

On the 60A CTs, there is a 100% chance the capacity will be vastly exceeded when the 5-ton compressor kicks on.... Its LRA is 200A.

So, for a very brief period of time- its going to pull 200A through its 60A breaker.

•

u/mac3 26m ago

This kind of information might not be available (or accurate) for cheap consumer equipment but if you stay within the CT’s linear non-saturation window then you can probably experiment a bit with different ratios.

4

u/Billionth_NewAccount 11h ago

Can you elaborate on what you are using instead of single CTs on the individual Breaker? seems it's a 20-conductor cabel with small CTs on the end of each? Can you elaborate on which solid core CTS and how you wired them up? the setup looks neat

7

u/HTTP_404_NotFound 11h ago

Here is a pic from last night- might help clear up some questions-

The CTs themselves, are nothing fancy.

https://www.aliexpress.us/item/3256801898427354.html https://www.aliexpress.us/item/3256804073775017.html

The 20 conductor cable, has 10 different color pairs. Red, Red stripe, Yellow, Yellow strip, etc.

Each pair supports a single CT. The CTs are connected to the cable using UL-listed butt-crimps. The UL-listed part is extremely important here.... The non-UL crimps are not nearly as thick, and do not create a secure bond with the cable. Every single one of the crimps was tug-tested too.... and the wire will break, before it pulls out of the crimp.

Then.... heat shrink wrapping the crimp connectors..... and then heat shrink on top of those, to keep everything nice and tidy.

5

u/Billionth_NewAccount 10h ago

So Each CT lead is joined to the 20-cable with a crimped butt connector. How did you do the second crimp? I also have one of those close-ended crimpers and the wire needs to be open to get the tool off the wire, no?

Where did you get UL rated Crimps? I also have some cheapo ones and they are trash.

My other thought was to use the solder filled heatshrink butt-connectors, did you consider those?

5

u/HTTP_404_NotFound 10h ago

How did you do the second crimp?

Well, I have quite a few pairs of crimpers, from nice to not nice... And honestly, the pair which did the best job, was one of the crappiest sets I had.

The nice set of crimps- the connectors kept getting stuck in them, and the crimps were just not as secure.

Where did you get UL rated Crimps? I also have some cheapo ones and they are trash.

Here ya go

https://www.amazon.com/dp/B072V27QN4

> My other thought was to use the solder filled heatshrink butt-connectors, did you consider those?

I have a set of those I picked up a while back, and I absolutely hate them.... Maybe, I just have a really bad set, but, the plastic sheathing would usually be a molten puddle long before the solder finally melted and bonded to the copper.

That- and after using the butt connectors I linked above for this project- I'll be ordering quite a few more of these. These things were fantastic to work with.

Edit, actually went ahead and ordered them now.... in a few different sizes too. These things were outstanding to work with.

1

u/Billionth_NewAccount 9h ago

Thank you! the Heatshrink connectors need to be heated very slowly and evenly, from the middle out. it's only easy after you do a bunch of them

1

u/HTTP_404_NotFound 7h ago

I'd say- after using these crimp connectors, I won't be soldering wires together anytime soon, with the exception of building/modifying PCBs.

These go in FAST too. When- I saw the wire will break before it pulls out, I was not kidding. I tested quite a bit before putting in the time and effort of doing all 60+ wire crimps!

4

u/hfidek 11h ago

when dad really wants you to turn off the lights because he's "not made of money".

4

u/HTTP_404_NotFound 11h ago

lol, while I do run around and turn lights off and fuss about lights being left on....

I do acknowledge- I use most of the power.

Between- my office, and all of the monitors/computers here, and my server rack... I don't have much room to fuss too much about a few lights being left on. But- doesn't stop me!

3

u/chuyskywalker 10h ago

when dad really wants you to turn off the lights because he's "not made of money".

Naaa, that's what the automations are for. ;)

3

u/LondonBenji 10h ago

This is EXACTLY what I've been looking to do, and have been eyeballing the KinConys for a while! How are they holding up? Any issues with them so far?

I'm in a similar situation as you as I have 24 breakers in my sub-panel and have been agonising over how to do it neatly, and this is perfect!

6

u/HTTP_404_NotFound 10h ago

Well, having used and experienced.... Iotawatt, CircuitSetup, Emporia Vue, and Refoss-

Hands down- these are my favorite solution so far. Open firmware, and hardware. The price isn't unreasonable. And, it runs firmware and does exactly what I want it to do.

Also- has direct modbus support, which is great, since I'm using modbus for collecting a ton of my solar related data.

That being said, A single N60 would be a bit nicer then two N30s. but- yea... stuff happens.

0

u/sadokx 10h ago

Better than Shelly?

2

u/HTTP_404_NotFound 7h ago

I don't think shelly has any solutions for doing.... CTs at this scale.

I mean, SHelly 3EM.... would take... oh, 30 of those to hit the channel density I have here. At a price of 120$ each, thats a bit chunk of change.

3

u/dosman33 10h ago

This looks like the basement of CursedControls on yt

2

u/HTTP_404_NotFound 10h ago

I'm not going to lie- there are some ideas I may have borrowed from watching his series.

But, this project did start before I knew about his channel, so, Can't give him credit for a bunch of it.

That being said, don't be surprised when a PLC cabinet pops up at my house.

BUT..... like his garage- there is a lot of conduit here.

2

u/thatoneguy009 11h ago

Codex has been making my solar dashboards in the same style 😂

2

u/HTTP_404_NotFound 11h ago

Its mostly claude here, Its, functional. Not great or fantastic. But, functional.

I can view all of the data in home assistant too though. The software I created, automatically configures all of the energy mappings in HA for me.

Though- I rarely look at the data here. But, it is tracked and maintained there!

1

u/thatoneguy009 11h ago

Frankly, you mind sharing so I can ask Codex to pick through and see if there's anything I've missed in my own projects? Things that you've already addressed or accounted for is my thought. I just started building my own boards out last week. Since I'm using a cheap stock aliexpress ESP32 dongle to my cheap inverter I'm still mostly at the start of data collection and resilience

5

u/HTTP_404_NotFound 10h ago

Suppose not, docs/source are all available from here :https://xtremeownage.github.io/rPDU2MQTT/

2

u/chuyskywalker 11h ago

Hey, I remember this install from a few posts back :)

I initially was using CT Clamps, however, this gets very messy, and the quantity of cables becomes a problem.

I ended up using cat6 for this. I wanted the small safety net of the wires having the internally twisted pairs. Still allowed for 4 ct's per "wire", but it definitely adds up to a big bundle-o-wires.

And, that picture of "applying the ct's to wires" slog...I feel that in muh bones. It's a LOT of stripping, clamping, and ferrul'ing. And you have to keep it all consistent!

minor detail- but, all of the voltage references, and CT cables are phase-marked with heat shrinking.

Less minor than that, imo. The kincony's use the phase data to calculate watts, so if you are readings amps from phase a, and volts from phase b, you'll get incorrect watts readings. Granted, in our 120/240 split homes, the voltage of the two phases are usually the same, or close enough to not matter, but it's not always the case.

3

u/HTTP_404_NotFound 11h ago

> I ended up using cat6 for this. I wanted the small safety net of the wires having the internally twisted pairs. Still allowed for 4 ct's per "wire", but it definitely adds up to a big bundle-o-wires.

Funny you mention that- that is actually what I originally had done. (Literally- I had 80% of everything done, using CAT6)

But, I ripped it all out this weekend, and replaced it with the 20C cable instead. The 20C, works perfectly with the 20 pin connectors too. It was bothering me that each connector would fit two and a half cables, and I would either have to split a cable, or leave half of it unused.

Other then the minor non-issues I was obsessing over, cat6 worked just fine. I will be using CAT6 to run remote CTs to a few of the sub panels around the house soon though. Its literally perfect for it.

ALSO- a random note- keystones worked really good for this too.... The CTs slot right into a cat6 keystone.

> Less minor than that, imo. The kincony's use the phase data to calculate watts, so if you are readings amps from phase a, and volts from phase b, you'll get incorrect watts readings. Granted, in our 120/240 split homes, the voltage of the two phases are usually the same, or close enough to not matter, but it's not always the case.

Look close at the pictures on the main post- all of the cables are phase-marked. Either black heat shrinking, or red. Ignore the panel on the right, its all 240v.

I spent a good amount of effort ensuring everything was correctly aligned to the correct pole.

Not- that its going to make a huge difference, but, it did make me feel better when everything lined up perfectly.

2

u/chuyskywalker 10h ago

Oh, we're fully in agreement. Should be done; likely wouldn't ruin the metrics, but it's good have it correct since doing so also gets you a proper PowerFactor.

1

u/HTTP_404_NotFound 7h ago

BUT, keep in mind, the N30 calculates energy usage on an embedded chip, and it uses the voltage reference. If the reference is off- you will not get correct energy data.

Edit- the ESP32 READs its data from the underlying chips, and does not calculate the energy itself. Technically, you could do the calculations on the esp and pull the voltage reference from one of the other chips. but- fyi.

1

u/chuyskywalker 3h ago

Yeah, the embedded arm units are doing all the real work. (Which, side note, are not super fun to update.)

To clarify what I meant: pulling the volts & amps and just multiplying them together would actually produce the wrong data.

What I'm talking about is the difference between VoltAmps and Watts. For a DC system, volts*amps=watts. Watts there is the same as voltamps. However, for an AC system that's not true. You can have amps the flow back and forth and do no "work" (ie: watts). They just are the noise of magnetic fields setting up and collapsing as the ac wave form cycles. Still counts as amps flowing through the wires, but doesn't get spent at the load.

If you take a close look at your metrics, you'll see that the reported volts * amps != watts that the unit reports, and this is correct. The difference will be very pronounced on things with motors (ac, heatpumps, etc) and much more minimal on items that are just electronics. Having worked mostly with ebike electronics for a while now (all dc) I didn't know about powerfactor much prior to configuring the N60 and thought the unit was busted, lol!

The reason those arm chips are in there is because they're doing a lot more than just snapshot volt/amp reading, but tracking the volt/amp waveforms and doing whatever fancy math is required to properly measure watts.

This all gathers up and measures out to kWh's used and charged for. The vast majority of places charge you at your watts used, and just ignore the powerfactor overhead of all the amps that are doing "non work". (Industrial locations, big heavy machines, much induction, don't get this consideration because if they have a machine that pulls 100A with a PF of 0.5, the power company has to support pushing 200A over the wires. Not something they'd be happy about :D)

Just goes to show -- really well made devices.

2

u/xentorius83 10h ago

Damn. Congrats… and you just gave me new ideas :)

3

u/HTTP_404_NotFound 10h ago

Careful- the rabbithole goes deep!!!!!!

2

u/bobjoylove 10h ago

I love those tiny ct clamps

1

u/HTTP_404_NotFound 7h ago

Myself included. I liked them so much, I pulled all of the clamps down... and I had clamps on 75% of the circuits!

1

u/dadwhoneedsinfo 10h ago

Looks great, but as a fire inspector not having a surge protected power strip is risky

1

u/HTTP_404_NotFound 10h ago

There is mains-level surge protectors up at the distribution box!

But- all of those power bricks will be replaced/removed before this is officially "DONE".

I have a panel about 10' to the right, which contains inline surge protection, and dedicated DC power supplies. Once I bend and run another piece of 1/2 or 3/4" EMT, I will be running 24v directly from that panel to power these units.

Of course- this panel is not finished either, I need to move everything around, add another row, and do some more cleanup on these cables.....

But, little by little.

(Don't worry- the water fittings here, are temporary.... had to get that somewhat mocked out.)

1

u/worldburger 10h ago

How do you use the IotaWatt or is it a relic of the pre-2xN30 past?

1

u/HTTP_404_NotFound 7h ago

Right now, its still running the 100/200A CTs on the feeds coming into these panels.

I have not fully decided yet if I will be replacing its work with the N30s. Or, if I might expand it out a bit more.

But- it feeds data to emoncms, and I pick it up from there.

1

u/red_vette 8h ago

Yeah, the CT's get a little much. I have 64 between my 4 Emporia Vues at my house.

1

u/ten300 7h ago

Pretty nice, going to borrow a lot of your ideas! My electricity costs are way too high, drives me bonkers not having tools in place to know exactly why.

2

u/HTTP_404_NotFound 7h ago

Just keep in mind- once you go down the rabbithole, good chance you will spend more implementing then you would otherwise save!

But, I really like data. so. here we are.

1

u/ReadyNeck3258 7h ago

“I’m heading down to the garage honey! See you next decade!”

1

u/HTTP_404_NotFound 7h ago

Basically. lol. I've been working on it since.... June.

Granted- the garage is only a small part of the project.

2

u/todd0x1 7h ago

Looks good! I will spare you from my usual NEC / UL rant on installations like this. I love the visualization, I haven't seen that software before will have to check it out.

2

u/HTTP_404_NotFound 7h ago

The software originally started as something to pull data from my vertiv rPDUs... I wrote by hand quite a few years back.

And...... then well, claude was strongly leveraged to allow me to scope-creep it into oblivion.

But, tldr; it collects, stores and reports on energy. Integrates energy with emoncms, prometheus, and home assistant. and mqtt. and supports collecting directly from modbus, mqtt, emoncms. and supports pulling directly from tigo optimizers too. And of course, has a floor planning tool, where I can trace/draw.

https://xtremeownage.github.io/rPDU2MQTT/

I will spare you from my usual NEC / UL rant on installations like this.

I'm all ears if you spot something! (Ignoring the white pipe fitting on one of the boxes). It actually was designed and inspected per code!

Notice- the two 2" conduits going up from the main panel? That was done to try and facilitate the HEC requirements of 10 conductors per cross section.

Conduit is clamped a minimum of every 16 inches. Lots of effort placed into EGCs, and locations.

The uh, 3d printed wire brackets to hold the THWN-2 in place, yea, that isn't gonna pass NEC/UL. But- Most everything else is up to code!

1

u/todd0x1 6h ago

Oh you made that? Cool!!!! I actually have an application where I might have a use for it -I need to record power consumption over a few days. I have some modbus wattnode energy meters and was looking for a software to use with them.

Since you asked..... the NEC stuff I noticed at first glance and please correct me if I am wrong on anything,

-The energy meters have to be listed, those dont appear to be
-The CTs have to be listed, or be recognized components that are part of a field installed listed system, the ones pictured dont appear to be given the wire that's coming out of them.
-Wire splices (the ones from the CTs to your wire) have to be listed, not sure if whatever crimp you used and the heatshrink is a listed combination
-The energy meters likely need supplemental protection on their voltage inputs
-What is that 20c cable you used? What type is it, or what does the legend on it say?

All that said, it looks like you know what you're doing and put in the work to do it well. You wouldn't believe how many of these ive seen with the energy meter crammed into the breaker panel and cat5 run in the same conduit with power conductors.

1

u/jldubz 7h ago

Are you collecting data into a local buffer before sending it to HA or are you piping everything over to a remote server via mqtt or similar and then crunching it down? Curious about bandwidth considerations

1

u/DigitalCorpus 6h ago

Nice to see your update. Thanks for the detailed documentation

1

u/crashandwalkaway 5h ago

Urgh when I did this, I used Emporia Vue2.. the damn channels started dropping over a few weeks with circuits showing no data/not connected. Panel off.. wiggle... repeat. Got fed up, called Emporia and got a new module. Easy enough to replace but then 3 months later...

2 are still down and I'm bitter about it. Thankfully the large CT's count total usage and give you a difference but still... I wanna know how much it cost to cook that roast for 4 hours!

HomeAutomation problems, gotta love it.

•

u/BystanderNewt 14m ago

Very impressive! How does the cost compare with smart panels? I'm specifically thinking of something like a leviton load center with the 2nd gen smart breakers. I got the panel but didn't do the smart breakers yet. If the cost per circuit was cheaper than those damn breakers, I'd heavily consider doing something like that instead.

•

u/nodiaque 2m ago

Now what I need is to learn how to do that and solar. Solar quote here in Quebec are 15k-25kCAD for 11 panels, installation and everything connected.

And the per line monitoring, a dream. To be able to know exactly which breaker is doing the ghost drain and such, perfection.

-1

u/BigGreenBillyGoat 11h ago

Have you ever considered a Span breaker box?

7

u/HTTP_404_NotFound 11h ago

ZERO CLOUD DEPENDENCY.

I will not have ANY cloud dependency for any of my IOT or automation. None!!!!!!

(But- Yes- I did consider it very early on in the project, until I realized it would have a cloud dependency. )

I even built support to locally poll the tigo units from my solar panels, to remove myself from their cloud dependency. Because, they wanted me to pay for premium in order to see the voltage/amp data from optimizers that I paid for and owned.

Screw that.

1

u/chuyskywalker 10h ago

locally poll the tigo units

I also have tigo units -- have you put up that code anywhere?

2

u/HTTP_404_NotFound 7h ago

1

u/chuyskywalker 4h ago

Nice, thanks. That lead me down some rabbit holes till I found https://rar.github.io/esphome-tigomonitor/ which is more my style (just regular esphome + ha stats; nothing mqtt fancy more than that). None-the-less it'll be one less cloud adapter to think about :D

3

u/chuyskywalker 11h ago

Way more expensive and cloud dependent. (OK, technically they have a local API now, but they only added that extremely begrudgingly because hackers reverse engineered their first non-open api. I award them no points for that.) The only perk to the span is load shedding, but I think that's over-hyped most of the time.

1

u/HTTP_404_NotFound 7h ago

The only perk to the span is load shedding,

And I have the EG4 Gridboss to handle load shedding for me!

1

u/LondonBenji 11h ago

Since Span breaker boxes are an utter rip off due to the >$6,000 entry cost, and the fact that this OP DIY'd everything themselves, I'm going to go ahead and guess "No".