Comments on: Obvious Idea #1: OpenStreetMap for AR Tracking Images http://programmerjoe.com/2010/03/13/obvious-idea-1-openstreetmap-for-images/ Joe Ludwig's blog Sun, 01 Jan 2012 19:08:41 +0000 hourly 1 http://wordpress.org/?v=3.0 By: Robert http://programmerjoe.com/2010/03/13/obvious-idea-1-openstreetmap-for-images/comment-page-1/#comment-407585 Robert Mon, 15 Mar 2010 15:20:15 +0000 http://programmerjoe.com/?p=203#comment-407585 Look a bit further into AWS and the like, and you discover that IO into and between individual machine instances (equivalent of disk IO) is shocking. This is due to the technologies (virtualization) these services are built on. Consumer demand won't just fix that. I'm also not sure if they provide the gigs of memory that these huge feature indexes require. You would essentially be trying to build a distributed database, which is a notoriously difficult area of computer science. I'm fairly convinced a cluster for this sort of work would have to be custom designed. Look a bit further into AWS and the like, and you discover that IO into and between individual machine instances (equivalent of disk IO) is shocking.

This is due to the technologies (virtualization) these services are built on. Consumer demand won’t just fix that.

I’m also not sure if they provide the gigs of memory that these huge feature indexes require. You would essentially be trying to build a distributed database, which is a notoriously difficult area of computer science.

I’m fairly convinced a cluster for this sort of work would have to be custom designed.

]]> By: Joe http://programmerjoe.com/2010/03/13/obvious-idea-1-openstreetmap-for-images/comment-page-1/#comment-407501 Joe Sun, 14 Mar 2010 15:31:56 +0000 http://programmerjoe.com/?p=203#comment-407501 When I talk about cloud computing providers I was thinking specifically of Amazon Web Services which already hosts many large datasets. Other options would be Google App Engine or Windows Azure. These providers certainly have enough IO and memory, or would if there were a market for it. You bring up a good point though. This will require far more processing on the back end than OpenStreetMap requires. That may mean commercial providers between the data and the end user's device even if the data itself is actually free. When I talk about cloud computing providers I was thinking specifically of Amazon Web Services which already hosts many large datasets. Other options would be Google App Engine or Windows Azure. These providers certainly have enough IO and memory, or would if there were a market for it.

You bring up a good point though. This will require far more processing on the back end than OpenStreetMap requires. That may mean commercial providers between the data and the end user’s device even if the data itself is actually free.

]]> By: Robert http://programmerjoe.com/2010/03/13/obvious-idea-1-openstreetmap-for-images/comment-page-1/#comment-407500 Robert Sun, 14 Mar 2010 15:00:38 +0000 http://programmerjoe.com/?p=203#comment-407500 None of these 'cluster providers' will have anything like the IO and memory needs mass bundling will need. Their clusters are not set up for this sort of workload. None of these ‘cluster providers’ will have anything like the IO and memory needs mass bundling will need.

Their clusters are not set up for this sort of workload.

]]>