1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How do you cope with huge MySQL databases?

Discussion in 'Black Hat SEO Tools' started by cooooookies, Oct 22, 2010.

  1. cooooookies

    cooooookies Senior Member

    Joined:
    Oct 6, 2008
    Messages:
    1,008
    Likes Received:
    216
    With huge I mean millions and millions of rows. Already red here and there some recommendations. Increasing key cache size and such stuff is not helping since the key exceeds the memory size. Using no PI at all: quick inserts, slow selects. Vice versa for e.g. a autoincrement PI.

    What I have: only simple selects and inserts. No joins, no other stuff. Only one primary index as autoincrement int.

    Solutions? Oracle? PostgreSQL? SSD-Disk?

    A simple solution is to split the table on the costs of higher maintenance? Anything new from mysql to do that "automatically"?
     
  2. admhat

    admhat Newbie

    Joined:
    Jun 13, 2010
    Messages:
    48
    Likes Received:
    12
    MySQL has no problem handling millions or rows. I currently have ~100 million rows for one table.

    • Is your application read or write heavy?
    • If your application is read heavy, are you caching results?
    • Can you prune old records from the database?
    • Are your queries optimized? Sometimes really stupid things like OFFSET can crush a db.
    • Is your table properly indexed.
    • The list goes on an on...

    If you need any help you may contact me privately.
     
    Last edited: Oct 22, 2010
  3. ADHD-Dude

    ADHD-Dude Power Member

    Joined:
    Apr 17, 2010
    Messages:
    592
    Likes Received:
    119
    I have the same problem slow searching, the only thing I could do is to increase the file execution time, until I can get an i7
     
  4. demoniox

    demoniox Registered Member

    Joined:
    Mar 5, 2007
    Messages:
    98
    Likes Received:
    83
  5. shudogg

    shudogg Regular Member

    Joined:
    Sep 23, 2008
    Messages:
    412
    Likes Received:
    153
    Occupation:
    Internet Marketing
    Location:
    Indiana
    Home Page:
    caching files to lower the amount of database calls
     
  6. sastro

    sastro Newbie

    Joined:
    Feb 27, 2009
    Messages:
    3
    Likes Received:
    0
    Paste your my.cnf here