Video to Mapillary

rmikke · 2015-06-12 14:36:15

Is there a tool to feed Mapillary from video file?

I have seen this tutorial, but I really can't spend so much time after every ride with camera.

It would be GREAT to have a tool (software or maybe page) that would just take video and GPX and then:
* allow to adjust time (offset between GPS time and camera time)
* extract a frame for every 50 meters or so (possibly selecting frames that are not blurred from movement), automatically adding time of frame in exif and direction from GPX (may require setting camera direction relative to car/bike), optionally aligning GPS position to road.
*upload the extracted images to Mapillary

That should not be VERY hard to code, as there is no image recognition (except for deciding if the image is blurred, that can be replaced by extracting a few neighbouring frames for each position and letting the user choose...).

There are additional options that could be added later, when someone is able to write image analysis software:
* support for helmet cameras, detecting and discarding frames where the user looks sideways,
* comparing the video with gpx and setting offset automatically according to turns,
* detecting some traffic signs and setting speed limits on OSM respectively,
* detecting information tables and adjusting town boundaries accordingly,
* and, most probably, many more.

rmikke · 2015-06-12 14:47:23

Oh, and one more option, that does NOT require image analysis:

If there are already some images of the road, it could suggest riding it with different relative camera direction, then extract images at exactly the same places, that prevous images. After a few rides we could have a 360 view in these points.

travel193 · 2015-06-12 14:57:03

I'm working on this wiki to find the best workflows for all things Mapillary so hopefully soon we will have a better video upload process for cameras that don't have built in GPS. https://github.com/mapillary/UserGuide

The manual uploader for video files will keep getting better and better so stay tuned.

Last edited by travel193 (2015-07-13 13:40:32)

rmikke · 2015-06-12 15:07:57

travel193 wrote:

Hi Rmikke,
What is your current workflow to upload from video?

None, I just wanted to start... I'm usually riding with camera "just in case" for some time, and I wanted to make some additional use of this.

Last edited by rmikke (2015-06-12 15:09:40)

travel193 · 2015-06-12 15:09:34

Ok understood.

Are you using a GoPro or similar action camera?
I'll get started on the best workflow for general needs soon.

rmikke · 2015-06-12 15:10:29

travel193 wrote:

Ok understood.
Are you using a GoPro or similar action camera?.

Yup. Veho Muvi K2.

travel193 · 2015-06-12 15:11:40

Ok thanks.

ligfietser · 2015-06-17 06:09:11

Mapillary can handle videos too:
http://blog.mapillary.com/update/2015/0 … pload.html

rmikke · 2015-06-17 06:25:50

ligfietser wrote:

Mapillary can handle videos too:
http://blog.mapillary.com/update/2015/0 … pload.html

Wow. This I will surely try out. So interesting, wow.

Strange thing, I could not google it. Maybe because I really didn't want to upload a video itself, but rather automatically extract frames and upload them, so I avoided phrase "upload video" while searching...

rmikke · 2015-06-20 01:37:44

rmikke wrote:

ligfietser wrote:
Mapillary can handle videos too:
http://blog.mapillary.com/update/2015/0 … pload.html
Wow. This I will surely try out. So interesting, wow.

OK, so I have tried. I have uploaded a video on Thursday and four on Friday, all with apropriate gpx files. Everything went OK, but I can see no sign they are uploaded. Not even some "one video uploaded and in processing", nothing. Is this normal? How long it takes to process a video?

travel193 · 2015-06-20 07:40:37

Hi rmikke,

Did you receive any emails at the account you signed up with? Their should be an email notification to inform you they are being processed and again when processing has been complete.

rmikke · 2015-06-20 10:34:06

travel193 wrote:

Hi rmikke,
Did you receive any emails at the account you signed up with? Their should be an email notification to inform you they are being processed and again when processing has been complete.

I have only received an email for a changeset I requested for someone else's track.

rmikke · 2015-06-21 15:06:53

rmikke wrote:

ligfietser wrote:
Mapillary can handle videos too:
http://blog.mapillary.com/update/2015/0 … pload.html
Wow. This I will surely try out. So interesting, wow.

Oooookay, so I uploaded a video Thursday night, bit my nails for two days, as there was not a single sign that a video has been uploaded, the YES!!!
I got an email, that my PHOTO is uploaded!!! Yay!!!

Of course I have had to check, how does it look. Well, not too well. Only first frame of the video is uploaded and it is placed at the end of gps track, not at the beginning. Surely not the outcome I have expected.

This is the link to what has been uploaded: http://www.mapillary.com/map/im/4wdGTrH8wzfaJ3dL8H6WPg

travel193 · 2015-07-13 13:53:55

Hi rmikke,

I just saw your issue with uploading sequences from video captured with the Veho Muvi K2.
I've posted an issue for it here: https://github.com/mapillary/mapillary_ … ssues/1155. You can subscribe for updates.

The computer vision team will have to calibrate the camera. In terms of the GPS, how are you recording your GPS tracks?

rmikke · 2015-07-14 11:28:35

travel193 wrote:

In terms of the GPS, how are you recording your GPS tracks?

Garmin GPSMap 60 CSx, and I have already posted an issue on it. On Garmin GPX files in general, I believe.

Announcement

#1 2015-06-12 14:36:15

Video to Mapillary

#2 2015-06-12 14:47:23

Re: Video to Mapillary

#3 2015-06-12 14:57:03

Re: Video to Mapillary

#4 2015-06-12 15:07:57

Re: Video to Mapillary

#5 2015-06-12 15:09:34

Re: Video to Mapillary

#6 2015-06-12 15:10:29

Re: Video to Mapillary

#7 2015-06-12 15:11:40

Re: Video to Mapillary

#8 2015-06-17 06:09:11

Re: Video to Mapillary

#9 2015-06-17 06:25:50

Re: Video to Mapillary

#10 2015-06-20 01:37:44

Re: Video to Mapillary

#11 2015-06-20 07:40:37

Re: Video to Mapillary

#12 2015-06-20 10:34:06

Re: Video to Mapillary

#13 2015-06-21 15:06:53

Re: Video to Mapillary

#14 2015-07-13 13:53:55

Re: Video to Mapillary

#15 2015-07-14 11:28:35

Re: Video to Mapillary

Board footer