cancel
Showing results for 
Search instead for 
Did you mean: 
cancel
Showing results for 
Search instead for 
Did you mean: 

Community Tip - Your Friends List is a way to easily have access to the community members that you interact with the most! X

Hadoop Extension for Thingworx

bikramp
1-Newbie

Hadoop Extension for Thingworx

Hi


I have a need to store large amount of data. Since there is a limitation of 15 mill records in streams, could you please advise an alternative to store the data?


Does Thingworx provide hadoop extension?


Regards

Saurabh



4 REPLIES 4
adam11
5-Regular Member
(To:bikramp)

Hi Saurabh,

We do not provide a Hadoop extension, but it would be possible for you to develop your own. What makes you think there is a limit on the # of records for

Streams

?


Regards,

Adam



Hi Adam


So does that mean that a stream can keep unlimited number of records? Is there any upper limit to it? Also, how does the data processing take place if at all streams can handle trillions of record.


I am talking about ~ 3,744,000,000 records per day.


Does this amount of data slow down the overall processing of thingworx?


Regards

Saurabh



Hi


Can anyone help me in this regard?


I am receiving data approximately ~ 3,744,000,000 records per day.

And I need to store data for atleast 1 year.



Please advise.


Regards

Saurabh Singhal



adam11
5-Regular Member
(To:bikramp)

Saurabh,

I've reached out to development to get some recommendations about how to best store this data.

Top Tags