[lug] Speed up osm2pgsql

[stimits at comcast.net]

I have a much smaller rack mount system I can't use just because of the noise...those 15k rpm 1 inch fans might lift a space shuttle, but require the same distance away to avoid ear damage.
 
Something I would ponder just because it is interesting, is that I've found some very good performance in the past using iSCSI. Would it be possible to have a system with this much RAM at a remote location serving iSCSI off of a very large RAM disk, and mount that on the local system as swap? Especially if you have 10g-base-T...
 
----- Original Message -----From: Lee Woodworth <blug-mail at duboulder.com>To: lug at lug.boulder.co.usSent: Thu, 08 Feb 2018 22:15:22 -0000 (UTC)Subject: Re: [lug] Speed up osm2pgsql

On 02/08/2018 01:43 PM, Alan Robertson wrote:> I had a similar thought...

>> steve.sullivan at mathcom.com:

>> Not sure if you want to go this direction, but on ebay >> there are a lot of big servers for sale that could >> put the whole problem in main memory, ending swapping.

>> For example, Dell R910 6 core with 256 GB RAM for about $800.

That is a good idea. We are removing equipment out of colo though,so it would need to be in my office. The power draw, fan noiseand space would problems. The current hardware is a pretty newsystem76 tower so the power and noise aren't bad.

I had considered the cloud but the google compute engine prices I seenow are about: $0.034 / vCPU hour $0.0045 / GB hour (first 6.5GB per vCPU) $0.0096 / GB hour $0.17 / GB / month (persisent ssd)

So just running: 4 cpu, 256GB ram, 500GB diskwould be $0.136 / hr vCPU $2.424 / hr ramwhich is $1874 / mo just for cpu and ramAdding the disk gets $1959 / mo not including network charges

A new box from system76 with 256GB would be ~$6,000 witha 250GB m2 ssd for root and 500GB nvme ssd for data.So the cloud doesn't make sense for us even with if it wasdiscounted 70%._______________________________________________Web Page: http://lug.boulder.co.usMailing List: http://lists.lug.boulder.co.us/mailman/listinfo/lugJoin us on IRC: irc.hackingsociety.org port=6667 channel=#hackingsociety
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lug.boulder.co.us/pipermail/lug/attachments/20180208/6437a59b/attachment.html>