Storage options for mass observation data

Looking for anyone that may have experience in storage of large amounts of big data!
Storage options for mass observation data
Like

Share this post

Choose a social network to share with, or copy the shortened URL to share elsewhere

This is a representation of how your post may appear on social media. The actual post will vary between social networks

Hi all. 

I'm currently exploring options for data storage en masse. With our project we will be collecting 24hr hydrophone data, drone video 6hr per day, photography & telemetry data. It's going to be a big whack on storage so am exploring options for various cloud storage potential. 

If anyone has any experience with large amounts of (easily accessible) data storage i'd love to hear from you

 

Cheers!

Please sign in or register for FREE

If you are a registered user on WildHub, please sign in

Go to the profile of Lara Reden
about 1 year ago

@Frank van der Most, maybe you can help?

Go to the profile of Frank van der Most
about 1 year ago

With this one, perhaps wildlabs.net is a better forum to ask.

My two cents: you'd need to be more specific about the amount of data in MBs or TBs that you expect to get. "6hr video" is not saying that much because a lot depends on filetype and quality for example.

If the total is ranging in TBs then consider from where all this data is going to be uploaded to a cloud. If the connection is lousy, you may have to wait for days. You'll need to know exactly how fast your network is and how much data you want to upload to be able to calculate approx. how much time it is going to take. Perhaps you are better of with harddisks ( including back-up disks ) instead of cloud space.

Go to the profile of Jackie Symmons
about 1 year ago

Adam

I’d go with using a multifunctional platform like Microsoft Teams. Allows you to store and share range of file types and establish different teams and chat groups as needed. But again like previous post you still need a hard backup of some type.

Go to the profile of Thirza Loffeld
about 1 year ago

Hi @Adam Roberts , Hope you're well. Just following up on your question to the community; 1) would you like any more advice on this topic or are the answers below sufficient and 2) have you been able to share it with the WILDLABS community? If not, I can help you perhaps. Thanks for letting me know!