Wednesday, March 28, 2012
Raid 10 with lots of disks. Where to place datafiles
Say you had 8, 12 or 16 disks purely for data (log on other disks).
Do you think it's best to create a single big raid 10 set for a single
filegroup with a single database file.
Create 2 or more raid 10 sets and split the data in a controlled manner. Eg
indexes and data or even by tables that are hit heavy (not easy to get right
when you have 100's of tables)
Create 2 or more raid 10 sets and have a single filegroup that owns a file
on each raid 10 set.
I know this is application specific but when you have a complex system you
could spend forever trying to work out the details.
Raid 10 will give me the megs per second but I was thinking maybe I'd be
better splitting the data up to get the transactions per second.
Paul
On Thu, 3 Nov 2005 19:26:24 -0000, "Paul Cahill"
<xyzpaul.xyzcahill@.dsl.pipex.com> wrote:
>I'm in setup new server mode so I'm just checking a few things.
>Say you had 8, 12 or 16 disks purely for data (log on other disks).
>Do you think it's best to create a single big raid 10 set for a single
>filegroup with a single database file.
Why so many disks? Is the database humongous?
>Create 2 or more raid 10 sets and split the data in a controlled manner. Eg
>indexes and data or even by tables that are hit heavy (not easy to get right
>when you have 100's of tables)
>Create 2 or more raid 10 sets and have a single filegroup that owns a file
>on each raid 10 set.
>I know this is application specific
Right.
> but when you have a complex system you
>could spend forever trying to work out the details.
>Raid 10 will give me the megs per second but I was thinking maybe I'd be
>better splitting the data up to get the transactions per second.
One big, fat RAID 10 will probably get you 80% of peak performance
with 20% of the bother. You can use SQLServer filegroups to optimize
wihin, if you like. Two more more smaller RAIDS might help, depending
on the app, depending on whether you NEED more help!
J.
|||Hi,
We should remember that the more heads/spindals you have for the RAID
the better the performance. With the disk technology today and the RPM
speeds I think you could get away with a large RAID and splice it up on
the OS level into different drives/devices.
Just a note from my SysAdmin days [those were the days ;-].
Shahryar
jxstern wrote:
>On Thu, 3 Nov 2005 19:26:24 -0000, "Paul Cahill"
><xyzpaul.xyzcahill@.dsl.pipex.com> wrote:
>
>Why so many disks? Is the database humongous?
>
>
>Right.
>
>
>One big, fat RAID 10 will probably get you 80% of peak performance
>with 20% of the bother. You can use SQLServer filegroups to optimize
>wihin, if you like. Two more more smaller RAIDS might help, depending
>on the app, depending on whether you NEED more help!
>J.
>
>
Shahryar G. Hashemi | Sr. DBA Consultant
InfoSpace, Inc.
601 108th Ave NE | Suite 1200 | Bellevue, WA 98004 USA
Mobile +1 206.459.6203 | Office +1 425.201.8853 | Fax +1 425.201.6150
shashem@.infospace.com | www.infospaceinc.com
This e-mail and any attachments may contain confidential information that is legally privileged. The information is solely for the use of the intended recipient(s); any disclosure, copying, distribution, or other use of this information is strictly prohi
bited. If you have received this e-mail in error, please notify the sender by return e-mail and delete this message. Thank you.
|||Lot's of disks because we are i/o bound on our current system and because
they are relatively cheap compared to the price of staff for one thing.
I could spend days and days fine tuning what tables/indexes get hit, when
and by whom. There are over 500 users and their usage can be quite
heterogeneous at times.
I've always thought raid 5 should be avoided, therefore raid 10.
I have prepared the system with fat raid 10's but I was thinking maybe I was
getting obsessed with i/o throughput and not thinking about random access.
All the heads on an array will be rushing to the same stripe at the same
time and then on to the next requested block of data.
However, say I had two smaller raid 10 sets then maybe I'd get a higher
transaction throughput although a slighly lower data rate per transaction.
Shahryar, I know you are correct. These new disks are blindingly quick but
disks haven't come on as much as cpu and memory speeds in the last few
years. They have mainly got bigger which is not necessarily best for rdbms.
Paul
"Shahryar G. Hashemi" <shahryar.hashemi@.infospace.com> wrote in message
news:eDAnkYM4FHA.476@.TK2MSFTNGP15.phx.gbl...
> Hi,
> We should remember that the more heads/spindals you have for the RAID the
> better the performance. With the disk technology today and the RPM speeds
> I think you could get away with a large RAID and splice it up on the OS
> level into different drives/devices.
> Just a note from my SysAdmin days [those were the days ;-].
> Shahryar
> jxstern wrote:
>
> --
> Shahryar G. Hashemi | Sr. DBA Consultant InfoSpace, Inc. 601 108th Ave NE
> | Suite 1200 | Bellevue, WA 98004 USA Mobile +1 206.459.6203 | Office
> +1 425.201.8853 | Fax +1 425.201.6150 shashem@.infospace.com |
> www.infospaceinc.com
> This e-mail and any attachments may contain confidential information that
> is legally privileged. The information is solely for the use of the
> intended recipient(s); any disclosure, copying, distribution, or other use
> of this information is strictly prohibited. If you have received this
> e-mail in error, please notify the sender by return e-mail and delete this
> message. Thank you.
sql
Raid 10 with lots of disks. Where to place datafiles
Say you had 8, 12 or 16 disks purely for data (log on other disks).
Do you think it's best to create a single big raid 10 set for a single
filegroup with a single database file.
Create 2 or more raid 10 sets and split the data in a controlled manner. Eg
indexes and data or even by tables that are hit heavy (not easy to get right
when you have 100's of tables)
Create 2 or more raid 10 sets and have a single filegroup that owns a file
on each raid 10 set.
I know this is application specific but when you have a complex system you
could spend forever trying to work out the details.
Raid 10 will give me the megs per second but I was thinking maybe I'd be
better splitting the data up to get the transactions per second.
PaulOn Thu, 3 Nov 2005 19:26:24 -0000, "Paul Cahill"
<xyzpaul.xyzcahill@.dsl.pipex.com> wrote:
>I'm in setup new server mode so I'm just checking a few things.
>Say you had 8, 12 or 16 disks purely for data (log on other disks).
>Do you think it's best to create a single big raid 10 set for a single
>filegroup with a single database file.
Why so many disks? Is the database humongous?
>Create 2 or more raid 10 sets and split the data in a controlled manner. Eg
>indexes and data or even by tables that are hit heavy (not easy to get right
>when you have 100's of tables)
>Create 2 or more raid 10 sets and have a single filegroup that owns a file
>on each raid 10 set.
>I know this is application specific
Right.
> but when you have a complex system you
>could spend forever trying to work out the details.
>Raid 10 will give me the megs per second but I was thinking maybe I'd be
>better splitting the data up to get the transactions per second.
One big, fat RAID 10 will probably get you 80% of peak performance
with 20% of the bother. You can use SQLServer filegroups to optimize
wihin, if you like. Two more more smaller RAIDS might help, depending
on the app, depending on whether you NEED more help!
J.|||Hi,
We should remember that the more heads/spindals you have for the RAID
the better the performance. With the disk technology today and the RPM
speeds I think you could get away with a large RAID and splice it up on
the OS level into different drives/devices.
Just a note from my SysAdmin days [those were the days ;-].
Shahryar
jxstern wrote:
>On Thu, 3 Nov 2005 19:26:24 -0000, "Paul Cahill"
><xyzpaul.xyzcahill@.dsl.pipex.com> wrote:
>
>>I'm in setup new server mode so I'm just checking a few things.
>>Say you had 8, 12 or 16 disks purely for data (log on other disks).
>>Do you think it's best to create a single big raid 10 set for a single
>>filegroup with a single database file.
>>
>Why so many disks? Is the database humongous?
>
>>Create 2 or more raid 10 sets and split the data in a controlled manner. Eg
>>indexes and data or even by tables that are hit heavy (not easy to get right
>>when you have 100's of tables)
>>Create 2 or more raid 10 sets and have a single filegroup that owns a file
>>on each raid 10 set.
>>I know this is application specific
>>
>Right.
>
>> but when you have a complex system you
>>could spend forever trying to work out the details.
>>Raid 10 will give me the megs per second but I was thinking maybe I'd be
>>better splitting the data up to get the transactions per second.
>>
>One big, fat RAID 10 will probably get you 80% of peak performance
>with 20% of the bother. You can use SQLServer filegroups to optimize
>wihin, if you like. Two more more smaller RAIDS might help, depending
>on the app, depending on whether you NEED more help!
>J.
>
>
Shahryar G. Hashemi | Sr. DBA Consultant
InfoSpace, Inc.
601 108th Ave NE | Suite 1200 | Bellevue, WA 98004 USA
Mobile +1 206.459.6203 | Office +1 425.201.8853 | Fax +1 425.201.6150
shashem@.infospace.com | www.infospaceinc.com
This e-mail and any attachments may contain confidential information that is legally privileged. The information is solely for the use of the intended recipient(s); any disclosure, copying, distribution, or other use of this information is strictly prohibited. If you have received this e-mail in error, please notify the sender by return e-mail and delete this message. Thank you.|||Lot's of disks because we are i/o bound on our current system and because
they are relatively cheap compared to the price of staff for one thing.
I could spend days and days fine tuning what tables/indexes get hit, when
and by whom. There are over 500 users and their usage can be quite
heterogeneous at times.
I've always thought raid 5 should be avoided, therefore raid 10.
I have prepared the system with fat raid 10's but I was thinking maybe I was
getting obsessed with i/o throughput and not thinking about random access.
All the heads on an array will be rushing to the same stripe at the same
time and then on to the next requested block of data.
However, say I had two smaller raid 10 sets then maybe I'd get a higher
transaction throughput although a slighly lower data rate per transaction.
Shahryar, I know you are correct. These new disks are blindingly quick but
disks haven't come on as much as cpu and memory speeds in the last few
years. They have mainly got bigger which is not necessarily best for rdbms.
Paul
"Shahryar G. Hashemi" <shahryar.hashemi@.infospace.com> wrote in message
news:eDAnkYM4FHA.476@.TK2MSFTNGP15.phx.gbl...
> Hi,
> We should remember that the more heads/spindals you have for the RAID the
> better the performance. With the disk technology today and the RPM speeds
> I think you could get away with a large RAID and splice it up on the OS
> level into different drives/devices.
> Just a note from my SysAdmin days [those were the days ;-].
> Shahryar
> jxstern wrote:
>>On Thu, 3 Nov 2005 19:26:24 -0000, "Paul Cahill"
>><xyzpaul.xyzcahill@.dsl.pipex.com> wrote:
>>I'm in setup new server mode so I'm just checking a few things.
>>Say you had 8, 12 or 16 disks purely for data (log on other disks).
>>Do you think it's best to create a single big raid 10 set for a single
>>filegroup with a single database file.
>>
>>Why so many disks? Is the database humongous?
>>
>>Create 2 or more raid 10 sets and split the data in a controlled manner.
>>Eg indexes and data or even by tables that are hit heavy (not easy to get
>>right when you have 100's of tables)
>>Create 2 or more raid 10 sets and have a single filegroup that owns a
>>file on each raid 10 set.
>>I know this is application specific
>>Right.
>>
>> but when you have a complex system
>> you could spend forever trying to work out the details.
>>Raid 10 will give me the megs per second but I was thinking maybe I'd be
>>better splitting the data up to get the transactions per second.
>>
>>One big, fat RAID 10 will probably get you 80% of peak performance
>>with 20% of the bother. You can use SQLServer filegroups to optimize
>>wihin, if you like. Two more more smaller RAIDS might help, depending
>>on the app, depending on whether you NEED more help!
>>J.
>>
>
> --
> Shahryar G. Hashemi | Sr. DBA Consultant InfoSpace, Inc. 601 108th Ave NE
> | Suite 1200 | Bellevue, WA 98004 USA Mobile +1 206.459.6203 | Office
> +1 425.201.8853 | Fax +1 425.201.6150 shashem@.infospace.com |
> www.infospaceinc.com
> This e-mail and any attachments may contain confidential information that
> is legally privileged. The information is solely for the use of the
> intended recipient(s); any disclosure, copying, distribution, or other use
> of this information is strictly prohibited. If you have received this
> e-mail in error, please notify the sender by return e-mail and delete this
> message. Thank you.
Raid 10 with lots of disks. Where to place datafiles
Say you had 8, 12 or 16 disks purely for data (log on other disks).
Do you think it's best to create a single big raid 10 set for a single
filegroup with a single database file.
Create 2 or more raid 10 sets and split the data in a controlled manner. Eg
indexes and data or even by tables that are hit heavy (not easy to get right
when you have 100's of tables)
Create 2 or more raid 10 sets and have a single filegroup that owns a file
on each raid 10 set.
I know this is application specific but when you have a complex system you
could spend forever trying to work out the details.
Raid 10 will give me the megs per second but I was thinking maybe I'd be
better splitting the data up to get the transactions per second.
PaulOn Thu, 3 Nov 2005 19:26:24 -0000, "Paul Cahill"
<xyzpaul.xyzcahill@.dsl.pipex.com> wrote:
>I'm in setup new server mode so I'm just checking a few things.
>Say you had 8, 12 or 16 disks purely for data (log on other disks).
>Do you think it's best to create a single big raid 10 set for a single
>filegroup with a single database file.
Why so many disks? Is the database humongous?
>Create 2 or more raid 10 sets and split the data in a controlled manner. Eg
>indexes and data or even by tables that are hit heavy (not easy to get righ
t
>when you have 100's of tables)
>Create 2 or more raid 10 sets and have a single filegroup that owns a file
>on each raid 10 set.
>I know this is application specific
Right.
> but when you have a complex system you
>could spend forever trying to work out the details.
>Raid 10 will give me the megs per second but I was thinking maybe I'd be
>better splitting the data up to get the transactions per second.
One big, fat RAID 10 will probably get you 80% of peak performance
with 20% of the bother. You can use SQLServer filegroups to optimize
wihin, if you like. Two more more smaller RAIDS might help, depending
on the app, depending on whether you NEED more help!
J.|||Hi,
We should remember that the more heads/spindals you have for the RAID
the better the performance. With the disk technology today and the RPM
speeds I think you could get away with a large RAID and splice it up on
the OS level into different drives/devices.
Just a note from my SysAdmin days [those were the days ;-].
Shahryar
jxstern wrote:
>On Thu, 3 Nov 2005 19:26:24 -0000, "Paul Cahill"
><xyzpaul.xyzcahill@.dsl.pipex.com> wrote:
>
>Why so many disks? Is the database humongous?
>
>
>Right.
>
>
>One big, fat RAID 10 will probably get you 80% of peak performance
>with 20% of the bother. You can use SQLServer filegroups to optimize
>wihin, if you like. Two more more smaller RAIDS might help, depending
>on the app, depending on whether you NEED more help!
>J.
>
>
Shahryar G. Hashemi | Sr. DBA Consultant
InfoSpace, Inc.
601 108th Ave NE | Suite 1200 | Bellevue, WA 98004 USA
Mobile +1 206.459.6203 | Office +1 425.201.8853 | Fax +1 425.201.6150
shashem@.infospace.com | www.infospaceinc.com
This e-mail and any attachments may contain confidential information that is
legally privileged. The information is solely for the use of the intended
recipient(s); any disclosure, copying, distribution, or other use of this in
formation is strictly prohi
bited. If you have received this e-mail in error, please notify the sender
by return e-mail and delete this message. Thank you.|||Lot's of disks because we are i/o bound on our current system and because
they are relatively cheap compared to the price of staff for one thing.
I could spend days and days fine tuning what tables/indexes get hit, when
and by whom. There are over 500 users and their usage can be quite
heterogeneous at times.
I've always thought raid 5 should be avoided, therefore raid 10.
I have prepared the system with fat raid 10's but I was thinking maybe I was
getting obsessed with i/o throughput and not thinking about random access.
All the heads on an array will be rushing to the same stripe at the same
time and then on to the next requested block of data.
However, say I had two smaller raid 10 sets then maybe I'd get a higher
transaction throughput although a slighly lower data rate per transaction.
Shahryar, I know you are correct. These new disks are blindingly quick but
disks haven't come on as much as cpu and memory speeds in the last few
years. They have mainly got bigger which is not necessarily best for rdbms.
Paul
"Shahryar G. Hashemi" <shahryar.hashemi@.infospace.com> wrote in message
news:eDAnkYM4FHA.476@.TK2MSFTNGP15.phx.gbl...
> Hi,
> We should remember that the more heads/spindals you have for the RAID the
> better the performance. With the disk technology today and the RPM speeds
> I think you could get away with a large RAID and splice it up on the OS
> level into different drives/devices.
> Just a note from my SysAdmin days [those were the days ;-].
> Shahryar
> jxstern wrote:
>
>
> --
> Shahryar G. Hashemi | Sr. DBA Consultant InfoSpace, Inc. 601 108th Ave NE
> | Suite 1200 | Bellevue, WA 98004 USA Mobile +1 206.459.6203 | Office
> +1 425.201.8853 | Fax +1 425.201.6150 shashem@.infospace.com |
> www.infospaceinc.com
> This e-mail and any attachments may contain confidential information that
> is legally privileged. The information is solely for the use of the
> intended recipient(s); any disclosure, copying, distribution, or other use
> of this information is strictly prohibited. If you have received this
> e-mail in error, please notify the sender by return e-mail and delete this
> message. Thank you.
Wednesday, March 7, 2012
Quick question about performance....
sets of fields? For example, I have a tree structure with a table for
adjacency information and a table for "node properties". I can ask
questions about the structure of the tree and generally manipulate nodes
without touching the "node property" table, however, if I want to fetch
"node properties" I have to perform a join with the adjacency table. So,
which is more efficient? One table with lots of fields or 2 related tables
that must be joined in order to execute a query?
Thanks
RobinRobin Tucker (idontwanttobespammedanymore@.reallyidont.com) writes:
> Is it better to have one table with lots of fields or many tables
> containing sets of fields? For example, I have a tree structure with a
> table for adjacency information and a table for "node properties". I
> can ask questions about the structure of the tree and generally
> manipulate nodes without touching the "node property" table, however, if
> I want to fetch "node properties" I have to perform a join with the
> adjacency table. So, which is more efficient? One table with lots of
> fields or 2 related tables that must be joined in order to execute a
> query?
There is not any clear-cut answer to that question. I would say that
rather than looking at performance at first hand, it is better to look
at other aspects. Which model describes the data best? Which model is
easiest to work with? Which model adheres best to the normal forms?
--
Erland Sommarskog, SQL Server MVP, esquel@.sommarskog.se
Books Online for SQL Server SP3 at
http://www.microsoft.com/sql/techin.../2000/books.asp|||I am guessing you did not design this and you are asking because you
don't like the design? Really, if you want to make a case for
efficiency, you should model both ways with the same data and look at
the execution plan. I think the main reason to keep it in two different
tables is for future maintenance and locking, such that one table can
be operated on while not disturbing the other.
Saturday, February 25, 2012
Quick 6.5 question
table can hold..
I've got an old 3rd party app suddenly throwing out lots
of these errors - 'The server could not expand a table
because the table reached the maximum size. '
Thanks in advance.Does the NT event log say, Event ID 2009'
//Ralph
>--Original Message--
>Does anyone know the maximum number of rows a SQL 6.5
>table can hold..
>I've got an old 3rd party app suddenly throwing out lots
>of these errors - 'The server could not expand a table
>because the table reached the maximum size. '
>
>Thanks in advance.
>.
>|||ok,
It doesn't neccessary need to be table in SQL server,
according to articles I found it is when creating a table
in the memory (system).
http://www.eventid.net/display.asp?eventid=2009&source=
The last section of that page you got links and
explanations about the error....
Good Luck.
//Ralph
>--Original Message--
>yes it does..
>
>>--Original Message--
>>Does the NT event log say, Event ID 2009'
>>//Ralph
>>--Original Message--
>>Does anyone know the maximum number of rows a SQL 6.5
>>table can hold..
>>I've got an old 3rd party app suddenly throwing out
lots
>>of these errors - 'The server could not expand a table
>>because the table reached the maximum size. '
>>
>>Thanks in advance.
>>.
>>.
>.
>|||Ralph, thanks - looks like a very useful link...
Cheers, steve
>--Original Message--
>ok,
>It doesn't neccessary need to be table in SQL server,
>according to articles I found it is when creating a table
>in the memory (system).
>http://www.eventid.net/display.asp?eventid=2009&source=
>The last section of that page you got links and
>explanations about the error....
>Good Luck.
>//Ralph
>
>>--Original Message--
>>yes it does..
>>
>>--Original Message--
>>Does the NT event log say, Event ID 2009'
>>//Ralph
>>--Original Message--
>>Does anyone know the maximum number of rows a SQL 6.5
>>table can hold..
>>I've got an old 3rd party app suddenly throwing out
>lots
>>of these errors - 'The server could not expand a table
>>because the table reached the maximum size. '
>>
>>Thanks in advance.
>>.
>>.
>>.
>.
>