Erlang/OTP Forums

Author Message

<  Erlang questions mailing list  ~  Amazon AWS SimpleDB based on erlang now in beta

Guest
Posted: Fri Dec 14, 2007 11:49 am Reply with quote
Guest
I was wondering if anyone has tried this or if now that it is out if any of
the team who created can give us some insights (for example how big is "large
data sets", etc):

From http://www.satine.org/archives/2007/12/13/amazon-simpledb/ :

What
Guest
Posted: Fri Dec 14, 2007 12:39 pm Reply with quote
Guest
This has an even better summary, I think:

http://www.sriramkrishnan.com/blog/2007/12/amazon-simpledb-technical-overview.html

On Dec 14, 2007, at 11:47 AM, Erlang List wrote:

> I was wondering if anyone has tried this or if now that it is out if
> any of
> the team who created can give us some insights (for example how big
> is "large
> data sets", etc):
>
> From http://www.satine.org/archives/2007/12/13/amazon-simpledb/ :

--
http://wagerlabs.com





_______________________________________________
erlang-questions mailing list
erlang-questions@erlang.org
http://www.erlang.org/mailman/listinfo/erlang-questions
Post recived from mailinglist
Guest
Posted: Mon Dec 17, 2007 7:42 am Reply with quote
Guest
I don't know where people are getting "large datasets" from. Amazon says:

"Amazon SimpleDB is designed to store relatively small amounts of data and is optimized for fast data access and flexibility in how that data is expressed."


So "relatively small amounts of data".


Tom

----- "Erlang List" <erlq@itsbeen.sent.com> wrote:
> I was wondering if anyone has tried this or if now that it is out if
> any of
> the team who created can give us some insights (for example how big is
> "large
> data sets", etc):
>
> From http://www.satine.org/archives/2007/12/13/amazon-simpledb/ :
>
> What’s cool about SimpleDB
> * Really large data sets
> * Really Fast
> * Highly Available - It’s Amazon. Running Erlang. Whoa.
> * On demand scaling - Like S3, EC2, with a sensible data metering
> pricing model
> * Schemaless - major cool factor for me here; items are little hash
> tables
> containing sets of key, value pairs
>
> http://aws.amazon.com/simpledb
> http://www.amazon.com/gp/browse.html?node=342335011
> http://docs.amazonwebservices.com/AmazonSimpleDB/2007-11-07/DeveloperGuide/?
> _______________________________________________
> erlang-questions mailing list
> erlang-questions@erlang.org
> http://www.erlang.org/mailman/listinfo/erlang-questions

_______________________________________________
erlang-questions mailing list
erlang-questions@erlang.org
http://www.erlang.org/mailman/listinfo/erlang-questions
Post recived from mailinglist
jay
Posted: Mon Dec 17, 2007 3:44 pm Reply with quote
User Joined: 06 Sep 2006 Posts: 139 Location: Los Angeles, CA USA
Depends on your perspective. The initial beta test size is 10Gb.
They plan to raise that limit.

The references to small data sets I believe are used by Amazon in
comparison to S3 (simple storage service). The cost of SimpleDB is
10x for storing data versus S3. S3 is filesystem based storage and
SimpleDB is a hash table. The intent is that you store your large
datasets in S3 and store just the metadata or queryable attributes in
SimpleDB.

jay

_______________________________________________
erlang-questions mailing list
erlang-questions@erlang.org
http://www.erlang.org/mailman/listinfo/erlang-questions
Post recived from mailinglist
View user's profile Send private message Visit poster's website
Guest
Posted: Sun Dec 23, 2007 10:53 pm Reply with quote
Guest
In message <47626D5C.7040507@itsbeen.sent.com> you write:
>I was wondering if anyone has tried this or if now that it is out if any of
>the team who created can give us some insights (for example how big is "large
>data sets", etc):

I've been off the team for three months now, so my information isn't
fresh, and in any event I can't say much more than what's in the
Amazon press release. I will note that everyone seems to understand
the right usage model - put your bulk data in S3 and indexable
metadata in SimpleDB.

I've seen a few blog entries stating disappointment that SimpleDB
doesn't have full text search capabilities, which completely
misunderstands the abstraction level that SimpleDB is working at.
One could build an appropriate full text search facility on top of
SimpleDB, with SimpleDB storing the inverted index. For any serious
use you'd want application-specific logic in your search anyhow,
so you're not missing much by not having it built-in.

Jim Larson
_______________________________________________
erlang-questions mailing list
erlang-questions@erlang.org
http://www.erlang.org/mailman/listinfo/erlang-questions
Post recived from mailinglist
Guest
Posted: Sun Dec 23, 2007 11:03 pm Reply with quote
Guest
In message <235408.4321197877018496.JavaMail.root@ly.sdf.com>
Tom Samplonius writes:
> I don't know where people are getting "large datasets" from. Amazon says:
>
>"Amazon SimpleDB is designed to store relatively small amounts of data and is
>optimized for fast data access and flexibility in how that data is expressed."
>
>So "relatively small amounts of data".

This refers to the data (attributes/values) in a particular item.
You can have a large amount of data, total, in a domain (10 GB currently,
and much, much larger eventually), and you can also have your data
spread across multiple domains, though at the hassle of multiplexing
your own cross-domain queries.

Jim Larson
_______________________________________________
erlang-questions mailing list
erlang-questions@erlang.org
http://www.erlang.org/mailman/listinfo/erlang-questions
Post recived from mailinglist

Display posts from previous:  

All times are GMT
Page 1 of 1
This forum is locked: you cannot post, reply to, or edit topics.

Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum