Back to the main page.

Bug 2490 - implement support for synchronizing MEG data with video and/or audio recordings

Status ASSIGNED
Reported 2014-03-05 12:50:00 +0100
Modified 2016-03-01 11:36:08 +0100
Product: FieldTrip
Component: core
Version: unspecified
Hardware: PC
Operating System: Windows
Importance: P5 enhancement
Assigned to: Robert Oostenveld
URL:
Tags:
Depends on:
Blocks:
See also:

Stephen Whitmarsh - 2014-03-05 12:50:26 +0100

I just want to put it out here. We are investigating the possibility for recording timestamps in high-speed video recordings to synchronize with MEG data. This is very helpful for epileptic workups. thing visualizing video with the data in databrowser. When I know more Ill post it here. Best, Stephen


Jan-Mathijs Schoffelen - 2014-03-06 15:41:18 +0100

Assigned to a named person, to keep this on the radar.


Robert Oostenveld - 2015-11-05 22:32:49 +0100

I received MEG data plus audio and video from Fanny. The recording and synchronisation is done with https://github.com/andreyzhd/VideoMEG.


Robert Oostenveld - 2015-11-05 22:54:17 +0100

I shared the first implementation in r10845. In the next commit I also added cfg.anonimize to place a bar over the eyes (for demonstration purposes, probably not relevant for normal use). mac011> svn commit Sending ft_audiovideobrowser.m Sending ft_databrowser.m Transmitting file data .. Committed revision 10845.


Robert Oostenveld - 2015-11-05 23:00:30 +0100

Dear all, I have added some of you to the CC list of this "bug" (i.e. feature request) so that I can keep you posted on the progress. There is now support for the NatMEG videomeg data in FT_DATABROWSER (linked to the MEG) and in FT_AUDIOVIDEOBROWSER (for only looking at the video based on triggers in the MEG). I will make some documentation online, probably as a "video" section under http://www.fieldtriptoolbox.org/reading_data#getting_started_with_other_data Figuring out and improving the synchronisation at the DCCN is still work in progress (Uriel is onto it). best Robert


Robert Oostenveld - 2016-02-17 17:40:34 +0100

note to self: One approach (with the EEG/MEG data central) is implemented with cfg.audiofile cfg.videofile and a right-mouse-button function in FT_DATABROWSER. Another approach (with the audio/video central) is implemented in FT_AUDIOVIDEOBROWSER.


Robert Oostenveld - 2016-03-01 11:36:08 +0100

I received a test dataset from Andrey. Using that, I had to refresh some code and found some issues. Nothing big. mac011> git commit fileio/ft_filetype.m [bug2490-video 17d885e] ENH - improve detection of audio and video data, see http://bugzilla.fieldtriptoolbox.org/show_bug.cgi?id=2490 1 file changed, 13 insertions(+), 10 deletions(-) mac011> git commit ft_audiovideobrowser.m [bug2490-video f1542c5] FIX - play back stereo correcly, i.e. different channels show up in separate soundview instances. See http://bugzilla.fieldtriptoolbox.org/show_bug.cgi?id=2490 1 file changed, 4 insertions(+), 1 deletion(-) mac011> git commit -a [bug2490-video de573ad] added external/videomeg code, this is the copy that I found on my hard drive, it might be that it is not 100% consistent with the code on https://github.com/andreyzhd/VideoMEG. See http://bugzilla.fieldtriptoolbox.org/show_bug.cgi?id=2490 6 files changed, 974 insertions(+) create mode 100644 external/videomeg/LICENSE create mode 100644 external/videomeg/README.md create mode 100644 external/videomeg/VERSION create mode 100644 external/videomeg/comp_tstamps.m create mode 100644 external/videomeg/load_audio0123.m create mode 100644 external/videomeg/load_video123.m