Data Is the New Dinosaur

Data is becoming one heck of a challenge to solve. Take a example of our Product ThingsHiFi- a 5KW Solar Grid-Tie UPS. This device send data every 30 seconds to ThingsCloud. On a daily basis we will have

(30/60)*60*24 = 2,880 insertions

Each data packet is around 6K byte, which makes

2880*6k= 17.2 mb/per day

For one month,

17.2 *30 = 516 mb/per device/per day

You can see where I’m going from here, even if we have a modest 1000 devices, then we will be looking around 500 gigs of data per month. Right now we are exploring different architectures to process this data.  Also, inserted  record has around 10 values.

So, per month per device it is

2880*10*30 = 864,000 values

Now, with 100 devices, it would be 86 million values, which needs to be queried. Suddenly from nowhere we need to work on big data …!!!