Milliseconds photon-to-photon latency projection system for adaptive optogenetics applications

In recent years, dynamic projection mapping, which dynamically and adaptively projects images to suit moving and transforming objects, has attracted much attention. There is another case in which similar projection is necessary for objects under a microscope. Optogenetics can make certain cells phot...

Full description

Saved in:
Bibliographic Details
Published inOptics express Vol. 33; no. 9; p. 20157
Main Authors Eda, Atsushi, Fujita, Toya, Oku, Hiromasa
Format Journal Article
LanguageEnglish
Published United States 05.05.2025
Online AccessGet full text

Cover

Abstract In recent years, dynamic projection mapping, which dynamically and adaptively projects images to suit moving and transforming objects, has attracted much attention. There is another case in which similar projection is necessary for objects under a microscope. Optogenetics can make certain cells photosensitive by genetic modification, and this can be used to input a disturbance to the cells. In particular, when the subject is in motion, the position of the cells to be stimulated changes in accordance with the motion or deformation of the subject, and the projection pattern must be changed dynamically to match this position. This requirement is exactly the same requirement as in dynamic projection mapping . Therefore, in this paper, we propose a projection method for microscopy with milliseconds latency. The proposed method is based on a low-latency digital micromirror device and high-speed vision system to achieve light projection that responds to deformation and movement of the object. The developed prototype system demonstrated a photon-to-photon latency of 6.56 ± 1.76 ms. Furthermore, dynamic projection mapping on a randomly moving target was also successfully demonstrated.
AbstractList In recent years, dynamic projection mapping, which dynamically and adaptively projects images to suit moving and transforming objects, has attracted much attention. There is another case in which similar projection is necessary for objects under a microscope. Optogenetics can make certain cells photosensitive by genetic modification, and this can be used to input a disturbance to the cells. In particular, when the subject is in motion, the position of the cells to be stimulated changes in accordance with the motion or deformation of the subject, and the projection pattern must be changed dynamically to match this position. This requirement is exactly the same requirement as in dynamic projection mapping . Therefore, in this paper, we propose a projection method for microscopy with milliseconds latency. The proposed method is based on a low-latency digital micromirror device and high-speed vision system to achieve light projection that responds to deformation and movement of the object. The developed prototype system demonstrated a photon-to-photon latency of 6.56 ± 1.76 ms. Furthermore, dynamic projection mapping on a randomly moving target was also successfully demonstrated.
In recent years, dynamic projection mapping, which dynamically and adaptively projects images to suit moving and transforming objects, has attracted much attention. There is another case in which similar projection is necessary for objects under a microscope. Optogenetics can make certain cells photosensitive by genetic modification, and this can be used to input a disturbance to the cells. In particular, when the subject is in motion, the position of the cells to be stimulated changes in accordance with the motion or deformation of the subject, and the projection pattern must be changed dynamically to match this position. This requirement is exactly the same requirement as in dynamic projection mapping . Therefore, in this paper, we propose a projection method for microscopy with milliseconds latency. The proposed method is based on a low-latency digital micromirror device and high-speed vision system to achieve light projection that responds to deformation and movement of the object. The developed prototype system demonstrated a photon-to-photon latency of 6.56 ± 1.76 ms. Furthermore, dynamic projection mapping on a randomly moving target was also successfully demonstrated.In recent years, dynamic projection mapping, which dynamically and adaptively projects images to suit moving and transforming objects, has attracted much attention. There is another case in which similar projection is necessary for objects under a microscope. Optogenetics can make certain cells photosensitive by genetic modification, and this can be used to input a disturbance to the cells. In particular, when the subject is in motion, the position of the cells to be stimulated changes in accordance with the motion or deformation of the subject, and the projection pattern must be changed dynamically to match this position. This requirement is exactly the same requirement as in dynamic projection mapping . Therefore, in this paper, we propose a projection method for microscopy with milliseconds latency. The proposed method is based on a low-latency digital micromirror device and high-speed vision system to achieve light projection that responds to deformation and movement of the object. The developed prototype system demonstrated a photon-to-photon latency of 6.56 ± 1.76 ms. Furthermore, dynamic projection mapping on a randomly moving target was also successfully demonstrated.
Author Oku, Hiromasa
Fujita, Toya
Eda, Atsushi
Author_xml – sequence: 1
  givenname: Atsushi
  orcidid: 0009-0008-5848-9802
  surname: Eda
  fullname: Eda, Atsushi
– sequence: 2
  givenname: Toya
  surname: Fujita
  fullname: Fujita, Toya
– sequence: 3
  givenname: Hiromasa
  orcidid: 0000-0002-4013-7373
  surname: Oku
  fullname: Oku, Hiromasa
BackLink https://www.ncbi.nlm.nih.gov/pubmed/40515205$$D View this record in MEDLINE/PubMed
BookMark eNpNkMtOwzAQRS1URB-w4AdQlrBIsZ04dpaoKg-pqBvYYvkxAVdJHGIXqX9PqgBiNVejo6uZM0eT1reA0CXBS5IV-e12vWQFxiU_QTOCyzzNseCTf3mK5iHsMCY5L_kZmuaYEUYxm6G3Z1fXLoDxrQ1J9-Gjb9Po0zEltYrQmkPS9X4HJrphFQ4hQpNUvk-UVV10X5D4Lvp3aCE6ExLVdbUz6giHc3RaqTrAxc9coNf79cvqMd1sH55Wd5vUUEFjaoGBrjSBcnijwFxYUeiScl5VlpRaCKoLbkgGigqLgVeM0IxbpjEpeVGwbIGux97h0M89hCgbFwzUtWrB74PMKBGcZ1zgAb36Qfe6ASu73jWqP8hfJwNwMwKm9yH0UP0hBMujb7ldy9F39g3OfnLu
Cites_doi 10.1145/3414685.3417802
10.1088/2040-8986/aa8299
10.1038/srep26297
10.1109/TVCG.2022.3150488
10.1016/j.cub.2008.06.077
10.1038/s41593-022-01094-6
10.1038/nmeth.1554
10.1109/LRA.2020.2969911
10.1111/cgf.13387
10.1364/OE.478416
10.1109/TVCG.2016.2518038
10.1038/s43586-022-00136-4
10.1098/rstb.2010.0043
10.1016/j.neuron.2011.06.004
10.1038/nmeth.1555
10.1038/nature05744
10.1109/MC.2012.154
10.1109/TVCG.2016.2592910
10.1038/nn1525
10.1063/1.1857632
ContentType Journal Article
DBID AAYXX
CITATION
NPM
7X8
DOI 10.1364/OE.560097
DatabaseName CrossRef
PubMed
MEDLINE - Academic
DatabaseTitle CrossRef
PubMed
MEDLINE - Academic
DatabaseTitleList CrossRef
MEDLINE - Academic
PubMed
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 1094-4087
ExternalDocumentID 40515205
10_1364_OE_560097
Genre Journal Article
GroupedDBID ---
123
29N
2WC
8SL
AAFWJ
AAWJZ
AAYXX
ACGFO
ADBBV
AEDJG
AENEX
AFPKN
AKGWG
ALMA_UNASSIGNED_HOLDINGS
ATHME
AYPRP
AZSQR
AZYMN
BAWUL
BCNDV
CITATION
CS3
DIK
DSZJF
DU5
E3Z
EBS
F5P
GROUPED_DOAJ
GX1
KQ8
M~E
OFLFD
OK1
OPJBK
OPLUZ
OVT
P2P
RNS
ROL
ROS
TR2
TR6
XSB
NPM
7X8
ID FETCH-LOGICAL-c282t-de5ebfb1e96006078d86b9277ffd19b882b67c13ea28d0e7f51237d5b01976653
ISSN 1094-4087
IngestDate Wed Jul 02 02:40:10 EDT 2025
Mon Jul 21 05:36:20 EDT 2025
Tue Jul 01 05:12:01 EDT 2025
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 9
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c282t-de5ebfb1e96006078d86b9277ffd19b882b67c13ea28d0e7f51237d5b01976653
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ORCID 0009-0008-5848-9802
0000-0002-4013-7373
OpenAccessLink https://opg.optica.org/viewmedia.cfm?URI=oe-33-9-20157
PMID 40515205
PQID 3218773780
PQPubID 23479
ParticipantIDs proquest_miscellaneous_3218773780
pubmed_primary_40515205
crossref_primary_10_1364_OE_560097
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2025-05-05
2025-May-05
20250505
PublicationDateYYYYMMDD 2025-05-05
PublicationDate_xml – month: 05
  year: 2025
  text: 2025-05-05
  day: 05
PublicationDecade 2020
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle Optics express
PublicationTitleAlternate Opt Express
PublicationYear 2025
References Boyden (oe-33-9-20157-R16) 2005; 8
Wang (oe-33-9-20157-R11) 2023; 31
Oku (oe-33-9-20157-R23) 2005; 76
Parker (oe-33-9-20157-R27) 2010; 365
Douglass (oe-33-9-20157-R17) 2008; 18
Govorunova (oe-33-9-20157-R19) 2022; 25
Zhang (oe-33-9-20157-R26) 2007; 446
Mine (oe-33-9-20157-R1) 2012; 45
Peng (oe-33-9-20157-R3) 2020; 39
Ronzitti (oe-33-9-20157-R20) 2017; 19
Grundhöfer (oe-33-9-20157-R2) 2018; 37
Yamato (oe-33-9-20157-R25) 2020; 5
Emiliani (oe-33-9-20157-R15) 2022; 2
Narita (oe-33-9-20157-R4) 2017; 23
Yizhar (oe-33-9-20157-R14) 2011; 71
Leifer (oe-33-9-20157-R21) 2011; 8
Tanimoto (oe-33-9-20157-R22) 2016; 6
Nomoto (oe-33-9-20157-R5) 2022; 28
Stirman (oe-33-9-20157-R18) 2011; 8
Lincoln (oe-33-9-20157-R13) 2016; 22
References_xml – volume: 39
  start-page: 1
  year: 2020
  ident: oe-33-9-20157-R3
  publication-title: ACM Trans. Graph.
  doi: 10.1145/3414685.3417802
– volume: 19
  start-page: 113001
  year: 2017
  ident: oe-33-9-20157-R20
  publication-title: J. Opt.
  doi: 10.1088/2040-8986/aa8299
– volume: 6
  start-page: 26297
  year: 2016
  ident: oe-33-9-20157-R22
  publication-title: Sci. Rep.
  doi: 10.1038/srep26297
– volume: 28
  start-page: 2125
  year: 2022
  ident: oe-33-9-20157-R5
  publication-title: IEEE Trans. Visual. Comput. Graphics
  doi: 10.1109/TVCG.2022.3150488
– volume: 18
  start-page: 1133
  year: 2008
  ident: oe-33-9-20157-R17
  publication-title: Curr. Biol.
  doi: 10.1016/j.cub.2008.06.077
– volume: 25
  start-page: 967
  year: 2022
  ident: oe-33-9-20157-R19
  publication-title: Nat. Neurosci.
  doi: 10.1038/s41593-022-01094-6
– volume: 8
  start-page: 147
  year: 2011
  ident: oe-33-9-20157-R21
  publication-title: Nat. Methods
  doi: 10.1038/nmeth.1554
– volume: 5
  start-page: 1907
  year: 2020
  ident: oe-33-9-20157-R25
  publication-title: IEEE Robot. Autom. Lett.
  doi: 10.1109/LRA.2020.2969911
– volume: 37
  start-page: 653
  year: 2018
  ident: oe-33-9-20157-R2
  publication-title: Comput. Graph. Forum
  doi: 10.1111/cgf.13387
– volume: 31
  start-page: 3945
  year: 2023
  ident: oe-33-9-20157-R11
  publication-title: Opt. Express
  doi: 10.1364/OE.478416
– volume: 22
  start-page: 1367
  year: 2016
  ident: oe-33-9-20157-R13
  publication-title: IEEE Trans. Visual. Comput. Graphics
  doi: 10.1109/TVCG.2016.2518038
– volume: 2
  start-page: 55
  year: 2022
  ident: oe-33-9-20157-R15
  publication-title: Nat. Rev. Methods Primers
  doi: 10.1038/s43586-022-00136-4
– volume: 365
  start-page: 2315
  year: 2010
  ident: oe-33-9-20157-R27
  publication-title: Philos. Trans. R. Soc., B
  doi: 10.1098/rstb.2010.0043
– volume: 71
  start-page: 9
  year: 2011
  ident: oe-33-9-20157-R14
  publication-title: Neuron
  doi: 10.1016/j.neuron.2011.06.004
– volume: 8
  start-page: 153
  year: 2011
  ident: oe-33-9-20157-R18
  publication-title: Nat. Methods
  doi: 10.1038/nmeth.1555
– volume: 446
  start-page: 633
  year: 2007
  ident: oe-33-9-20157-R26
  publication-title: Nature
  doi: 10.1038/nature05744
– volume: 45
  start-page: 32
  year: 2012
  ident: oe-33-9-20157-R1
  publication-title: Computer
  doi: 10.1109/MC.2012.154
– volume: 23
  start-page: 1235
  year: 2017
  ident: oe-33-9-20157-R4
  publication-title: IEEE Trans. Visual. Comput. Graphics
  doi: 10.1109/TVCG.2016.2592910
– volume: 8
  start-page: 1263
  year: 2005
  ident: oe-33-9-20157-R16
  publication-title: Nat. Neurosci.
  doi: 10.1038/nn1525
– volume: 76
  start-page: 034301
  year: 2005
  ident: oe-33-9-20157-R23
  publication-title: Rev. Sci. Instrum.
  doi: 10.1063/1.1857632
SSID ssj0014797
Score 2.4744277
Snippet In recent years, dynamic projection mapping, which dynamically and adaptively projects images to suit moving and transforming objects, has attracted much...
SourceID proquest
pubmed
crossref
SourceType Aggregation Database
Index Database
StartPage 20157
Title Milliseconds photon-to-photon latency projection system for adaptive optogenetics applications
URI https://www.ncbi.nlm.nih.gov/pubmed/40515205
https://www.proquest.com/docview/3218773780
Volume 33
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT9wwELYKFRIX1FKepchU3FAgm_iRHCu0Faq07GVX4tTIjh2xgDYRSSTgwG_v2E6yKd1KwCWKHMWOZr6Mv7HHMwgdy0jEUlLfIypkHkkl8YSmwtO-lplkKuA2z-zokl1Mya8rerUod2RPl1TyNH1aeq7kPVqFNtCrOSX7Bs12nUID3IN-4QoahuurdGwO8s1K49Kq8qS4zk054Cr33N3JnajsucpmscXo2eVtdpGTShQ2bCgvqhxG0C5fc28_u89bx4V9rB-KLmTD0HDlVmWrsi6vZx0U6puZ46ST_LGz-uPb2k5zs3sTkST6qw0BtbF9tGcgwR0En7OZJPWStsaquvQWDXrivokEAsKXGu-QEZD4eHhqWFjMFzNUuyv_YuLqwgntrhwjyXiYuFdX0McA3AZT0WL0POx2lQh3xXba720yTcGrZ92of_OT_zgdlnxMPqGNxmvAPxwEPqMPer6J1mz0blp-Qb_7QMAvgYAbIOAFELADAgYg4BYIuA8E3AfCFpr-HE7OL7ymcIaXggddeUpT86cNNLinPgMSqCImY5BIlqlBLMGpkoyng1CLIFK-5hmwvpArKoHvc8ZouI1W5_lc7yIM_rPKgCJTn2lC0kgM0ogBbZdA86lI_T30vRVXUrj8KMk_6thDR60gE7BeZktKzHVel0kIDJPzkEfQ0Y6TcNcNMeWHAp_uv2aIr2h9AdcDtFrd1_ob0MVKHtpllkOLhD--pm9s
linkProvider ISSN International Centre
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Milliseconds+photon-to-photon+latency+projection+system+for+adaptive+optogenetics+applications&rft.jtitle=Optics+express&rft.au=Eda%2C+Atsushi&rft.au=Fujita%2C+Toya&rft.au=Oku%2C+Hiromasa&rft.date=2025-05-05&rft.issn=1094-4087&rft.eissn=1094-4087&rft.volume=33&rft.issue=9&rft.spage=20157&rft_id=info:doi/10.1364%2FOE.560097&rft.externalDBID=n%2Fa&rft.externalDocID=10_1364_OE_560097
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1094-4087&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1094-4087&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1094-4087&client=summon