gmap-pedometer.com blog

Runner's highs (and lows)

  • gmap-pedometer.com
  • map
  • blog
  • bookmarked routes
  • workout log
  • forum
  • about
  • profile
  • login

Milermeter, Google and gmaps (LOL)

October 16, 2018 by Paul 15 Comments

Hello all, I bet you’ve been noticing a ton of changes on the site lately. I’m sorry I haven’t let you know what was coming in advance, but for reasons I’ll explain I’ve been too busy making the changes happen under a deadline, and now I have time to explain.

As of July 15, google announced drastic pricing changes to the cost structure of google maps. (Here’s a pretty good article about it.) Without getting too deep into the weeds, it meant that a number of services that once cost me a grand total of $0.00 became so expensive that I would have been losing money (a lot) on the site. (They gave a two month credit to get people used to it, so my real deadline was September 15.) I had to scramble to make changes, because though this site is a labor of love, I’m in no position to suport something that would lose money each month. (It’s really more of a labor of love with benefits.)

This has meant a number of changes, which I’ll outline below. I think I’ve been able to get just as good results as before (sometimes better!) Note that in every case, I haven’t been able to replace formerly free google services with other free services; I’m still paying much more than used to, just less than google’s exorbitant rates. I’ve learned a lot about the current landscape of google map competitors in the process, and it’s amazing to see how the field has grown. In fairness, google created this category, and even subsidized it to a large extent (little did I know how much,) so in a way I’m still grateful to them. Though mainly right now I’m pretty annoyed with them. Here’s the list of changes.

Maps

You’ve no doubt noticed that the map layers themselves have changed. I ended up changing this twice. First I changed from google to mapbox (a mapping-only competitor that offers basically all the same features, using OpenStreetMap data.) It turned out that mapbox’s pricing, while better than google’s, wasn’t as great as I’d thought, and so I had to switch off that too. (This article is a pretty good explanation) In the end, I bought a yearly license to use data from https://openmaptiles.com/ and am now hosting the tileserver myself. Honestly? From a nerdy-learning-opportunity perspective I really enjoyed setting up the tileserver, as it gave me a chance to run docker in production, set up nginx as a reverse proxy, use letsencrypt for free SSL, and hone my AWS skills.

You’ve probably noticed that the maps load differently now. They’ll seem to build themselves and fill in details as you zoom in, where they used to start out as blurry blocks and get get less progressively less blurry as data loaded in. This is because the switch gave me the opportunity to use vector tiles instead of raster — basically my tileserver sends you a document that tells your browser how to draw the map itself, instead of sending a batch of images to make up the map. It should make for quicker and smaller downloads of the maps (though it’s true it puts more of the work into your browser.) I happen to really like the effect, and I hope you do too.

This has also meant something of a brain transplant for the code. All the API calls that formerly called the google maps API now call similar code provided by mapbox, and this change was the lion’s share of the work I had to do. It means a lot has changed under the covers, so if you find a bug, that could be why (please let me know if you do.) That was why, for a little while there, the ability to edit routes in the middle (rather than just adding/removing points from the end) was disabled. It was the most time-consuming retrofit, and I just had to push it out til later to stay under the deadline imposed by google for pricing changes.

Satellite

It turns out that sending a giant super high resolution camera into space on the nose of a rocket, and taking pictures of Earth with it for decades, is kind of expensive. I now know that this is one of the biggest costs that google was subsidizing. Some companies already provide a similar service to their clients as they help provide high-resolution historical satellite images and many other things.  The provider I finally landed on for my map tiles had satellite data, but at much lower resolution, to the point of being basically unusable. I stayed with mapbox, who had better images, but it was still costing 40-50 dollars per day and wasn’t something I could continue to pay for. So, for a while, the site was set up to seriously curtail the amount of satellite imagery you could get. You could do a “glance” of satellite or hybrid images, then it would flip back to a map whenever you moved or zoomed.

Some of you guys reeeeeeeaaaaaallllly hated this.

I don’t blame you. I thought it sucked too. But some of y’all should really work on being a bit more polite about the emails you send to strangers on the internet.

Anyway. There’s good news. There’s a company called ESRI who sell all kinds of geographical data. They do so much business, in so many different types of data, it was a little hard to get a straight answer from them about whether I could get satellite images to use on website. It turns out I can! I literally had to talk to three different people in sales before I got to the right one who understood the type of license I need, but now the site has satellite and hybrid data again! Looks to me like the resolution isn’t quite what google had on offer, but I hope you’ll agree it’s enough to get the job done. If you’re curious, ESRI is charging me $500/year for this data, so it’s not like they’re giving it away, but it’s a rate that’s much easier to support. Interesting nerd note: the satellite images come from ESRI, but road outlines for the hybrid version are now coming from the tileserver I set up! I think that’s kinda cool.

Geocoding

This is another thing I was getting from google, and moved to a different provider for. Many of you noticed this and reported that the data quality was just not the same — whole countries no longer being found, and the results just not as consistent. I did some number crunching, and this is one of the (relatively) less significant google costs, around $10/$15 a day. I made the call that the quality of the data we were getting from google was worth it. And yes, out of bitterness, I would rather not give them the money each day, but I do care about the quality of the features, so google, you win this round.

Routing

One of the important features of the site is the ability to draw the route between the points you clicked. This is another thing that google was going to start charging for, that had been free before. It turns out there is an open source project to offer this feature based on Openstreetmap data, and I was able to stand up a server in AWS using this code to replace google’s version of the service. It’s quite cool how it works. It maintains a graph representing the street network of the whole world in RAM so the results come back fast. Which also means that it requires a very beefy server with loads of RAM, which is pretty expensive to run. That and the geocoding are the two biggest costs I had to take on in the course of this project. Long story short, there was a change under the covers to this feature, but hopefully you won’t notice a difference.

Conclusion

I wasn’t too thrilled with how I got treated by google after being one of their very first generation of mapping mashups. In case you discovered the site later, it was launched in 2005, (when people actually used the word “mashups”) and it was literally on the google maps API from the day it came out. But in the end, the work I’ve had to do to handle this change has been technically interesting and a great learning experience. And to be fair, many of the google competitors I’m now using almost certainly wouldn’t exist (or not in the same way) if google hadn’t disrupted people’s relationship with maps and geography. Now maybe google will be disrupted (I hope!) by other upstarts, which is as it should be.

I’m pretty much stuck with the domain gmap-pedometer.com for the site due to all the links and SEO out in the world that use it. It was always a bad domain name (too long, and what the hell does it mean?) and now there’s no “gmaps” left in the app at all. Serves ’em right!

As it turns out, I had a giant vulnerability in this business in the form of vendor lock-in — my fate was entirely determined by google. Not anymore! I intend to still maintain milermeter.com for the foreseeable future, and I wish you many many refreshing runs, walks, bike rides, and of course, pleasant hours seeing how far you went on the site.

Please keep coming back, apologies for the recent bugs and disruptions, and thanks for your patronage.

Facebooktwitterredditpinteresttumblrmail

Categories Site News

About Paul

See all the posts by Paul at this link.

Comments

  1. Louise says:
    October 22, 2018 at 11:29 am

    Can’t seem to view the static map or print a route map anymore – error message reads: ‘This site can’t load Google Maps correctly’ and Do you own this website g.co/staticmaperror/key.
    Any chance this can be fixed as it worked until recently

    • Paul says:
      October 23, 2018 at 6:46 am

      Thanks for the report. That probably was affects by the changes. I’ll take a look.

    • Paul says:
      December 4, 2018 at 8:00 am

      Ok, I’ve fixed this. Sharing should work now! Let me know if you have any trouble with it.

  2. Louise Elstone says:
    October 23, 2018 at 6:08 am

    No longer an error message when I try and print a route map. Now just a blank space on the page where the map should be… ?? Can this be fixed?

    • Joyce says:
      October 29, 2018 at 11:14 am

      I’m having the same problem – unable to print maps that I’ve outlined.

      • Paul says:
        November 28, 2018 at 7:59 am

        I’m going to work on fixing the print page next. However, in the meantime, I’ve just added a feature you might like just as much or better! Look for the new “download” button right next to “print”. This will create and download a snapshot of the map as an image.

      • Paul says:
        December 4, 2018 at 8:02 am

        Ok, I’ve fixed this. Sharing and printing should work now! Let me know if you have any trouble with it.

    • Paul says:
      December 4, 2018 at 8:01 am

      Ok, I’ve fixed this. Sharing and printing should work now! Let me know if you have any trouble with it.

  3. dupageRider says:
    October 31, 2018 at 12:37 pm

    No longer maps or routes to off road trails for cyclist/runner

  4. Geoffrey says:
    November 12, 2018 at 12:36 pm

    Wow – thanks for all the work! I’ve used gmap-pedometer only rarely, but first used it in the previous millennium (mid-1990s), which is several lifetimes in Web time. I really appreciate the simplicity and usability; most likely you have “competitors” out there, but I see no reason even to look.

    I see ads (of course) but no request for donations, which frankly I would gladly make. (The “Shop” link to Etsy is 404, by the way.)

    So, thanks, hope you keep this going forever (in Web time).

    • Paul says:
      November 17, 2018 at 8:35 pm

      Thank you! This site is a labor of love and it’s been my pleasure keeping it going. I can’t really believe how long it’s lasted myself. Thank you for the support! I’ve thought about a Patreon but honestly I’d rather spend the time fixing bugs and adding features 🙂

  5. Asher Samuels says:
    November 16, 2018 at 6:46 am

    Alphabets that are supposed to be Right-to-Left are showing as left-to-right (e.g. Hebrew). I don’t know if this is an issue from your end or from the underlying map.

    • Paul says:
      November 17, 2018 at 8:31 pm

      I now control the base layers myself in most cases. Which layer was it? I’ll research the change I’ll need to make to fix this.

    • Paul says:
      November 28, 2018 at 7:55 am

      OK, I’ve pushed a change that I think will address this. Can you take a look and let me know? This one is tricky to test, since I can’t read any right-to-left languages!

  6. Craig says:
    November 23, 2018 at 1:27 pm

    Thank you so much for the tool. I use it regularly for mapping distances for my runs, cycling and just everyday stuff. I too have been using it since you began and didn’t realize how much work went into the backend.

    Again, thank you. The tool is well used and truly appreciated.

Comments are closed.

Most popular posts

  • GmapToGPX bookmarklet
  • Staying Fit North of 40
  • Three Sneaky Ways to Get Your Kids to Exercise
  • Fully Clothed Showers, Frozen Hands and Other Pro Tips for Hot-Weather Workouts
  • Workout Trends Debunked!

Subscribe via Email

Sign up to receive posts through email
Loading

Runner Reactions

  • Increasing splits

    Facebooktwitterredditpinteresttumblrmail

  • Spectator at mile 18 with You’re Almost There!!! sign

    Facebooktwitterredditpinteresttumblrmail

  • Coach just figured out where I was hiding

    Hello world!

    Facebooktwitterredditpinteresttumblrmail

Archive by Month

Recent Posts

  • New feature: downloadable snapshot
  • Milermeter, Google and gmaps (LOL)
  • GmapToGPX bookmarklet
  • I ate five salads a day as part of my fitness challenge. You won’t believe what happened next.
  • Increasing splits

Recent Comments

  • Nick Jones on GmapToGPX bookmarklet
  • Stefano on GmapToGPX bookmarklet
  • David on New feature: downloadable snapshot
  • Brian on Milermeter tracker subscription information
  • Patricia B Rosen on GmapToGPX bookmarklet

Copyright © 2015 gmap-pedomter.com