User not logged in - login - register
Home Calendar Books School Tool Photo Gallery Message Boards Users Statistics Advertise Site Info
go to bottom | |
 Message Boards » » 1 trillion rows! Page [1]  
neodata686
All American
11577 Posts
user info
edit post

How many rows does your DB have?

11/15/2012 4:42:20 PM

jakis
Suspended
1415 Posts
user info
edit post



[Edited on November 15, 2012 at 4:52 PM. Reason : NERD'S]

11/15/2012 4:52:17 PM

quagmire02
All American
44225 Posts
user info
edit post

entire database or in a single table?

11/15/2012 7:24:34 PM

smoothcrim
Universal Magnetic!
18966 Posts
user info
edit post

a few quadrillion

11/15/2012 7:33:19 PM

neodata686
All American
11577 Posts
user info
edit post

Bazillion!

^^From my estimates one of our tables may be hitting a trillion soon. I know it's at least 500 billion+.

To be fair it's MPP architecture so technically it's split up into lots of sub-tables and the master queries the primary table by using a distribution key but for my purposes it's still one table.

-just thought it was cool. My company deals with big data and I'm just now learning a lot about database architecture and SQL. It's pretty neato.

[Edited on November 15, 2012 at 8:00 PM. Reason : s]

11/15/2012 7:59:20 PM

smoothcrim
Universal Magnetic!
18966 Posts
user info
edit post

i was serious about a few quadrillion..

11/15/2012 8:07:15 PM

neodata686
All American
11577 Posts
user info
edit post

11/15/2012 8:24:42 PM

MisterGreen
All American
4328 Posts
user info
edit post

i have a hard time wrapping my head around numbers that large.

a quadrillion? geez.

11/15/2012 8:58:00 PM

gs7
All American
2354 Posts
user info
edit post

So who do you guys use for your big data storage backend?

How many clients do you have accessing that data?

Rows are interesting, but the infrastructure is the cool stuff.

11/15/2012 9:14:03 PM

smoothcrim
Universal Magnetic!
18966 Posts
user info
edit post

aws.amazon.com

[Edited on November 15, 2012 at 9:34 PM. Reason : dynamodb - nosql]

11/15/2012 9:29:58 PM

neodata686
All American
11577 Posts
user info
edit post

We have our own hardware. Hosted or behind the clients firewall (depending on the type of client). Postgresql using Greenplum. Which is awesome.

http://www.greenplum.com/products/greenplum-database

11/15/2012 9:57:29 PM

Tarun
almost
11687 Posts
user info
edit post

nvm

[Edited on November 16, 2012 at 12:08 PM. Reason : dint read it right]

11/16/2012 12:07:18 PM

afripino
All American
11425 Posts
user info
edit post

how long does a select * take?

[Edited on November 16, 2012 at 12:15 PM. Reason : eleventy billion in my DB's]

11/16/2012 12:15:09 PM

neodata686
All American
11577 Posts
user info
edit post

Under a minute if there's no big joins.

11/16/2012 12:57:59 PM

smoothcrim
Universal Magnetic!
18966 Posts
user info
edit post

no relations so subsecond

11/16/2012 1:28:13 PM

neodata686
All American
11577 Posts
user info
edit post

Well aren't you too cool for school.

11/16/2012 1:46:02 PM

Tarun
almost
11687 Posts
user info
edit post

e-peen contest?

11/16/2012 1:48:04 PM

neodata686
All American
11577 Posts
user info
edit post

Doesn't count unless it's hosted with your own hardware.

11/16/2012 1:49:52 PM

AntecK7
All American
7755 Posts
user info
edit post

I feel the need to post this

https://www.youtube.com/watch?v=b2F-DItXtZs

11/21/2012 12:03:50 AM

Arab13
Art Vandelay
45180 Posts
user info
edit post

I'd say 32. The last time he got cornrows there was a good number of them.

11/29/2012 2:10:30 AM

r45t4-m4n
All American
629 Posts
user info
edit post

We use GreenPlum, Netezza, MS SQL and and old DB2 here. Every month one of the tables I work with gets ~180 million rows added. There are multiple tables like this, with historic data for about 12 years. We are phasing out netezza and DB2, I am responsible for the ETL from those servers using informatica.

11/30/2012 12:48:50 PM

Stein
All American
19842 Posts
user info
edit post

For any of you who record lots of time-series data, I have some friends who run a hosted database just for that: http://tempo-db.com/

Awesome guys, solid product.

11/30/2012 3:26:31 PM

smoothcrim
Universal Magnetic!
18966 Posts
user info
edit post

http://aws.amazon.com/redshift/

11/30/2012 4:54:45 PM

 Message Boards » Tech Talk » 1 trillion rows! Page [1]  
go to top | |
Admin Options : move topic | lock topic

© 2024 by The Wolf Web - All Rights Reserved.
The material located at this site is not endorsed, sponsored or provided by or on behalf of North Carolina State University.
Powered by CrazyWeb v2.39 - our disclaimer.