Access the full text.
Sign up today, get DeepDyve free for 14 days.
Soran Parsa, Disha Kamale, Sariah Mghames, Kiyanoush Nazari, T. Pardi, A. Srinivasan, G. Neumann, Marc Hanheide, Ghalamzan Amir (2020)
Haptic-guided shared control grasping: collision-free manipulation2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)
T. Pardi, R. Stolkin, E. AmirM.Ghalamzan (2018)
Choosing Grasps to Enable Collision-Free Post-Grasp Manipulations2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids)
Maurizio Maisto, C. Pacchierotti, F. Chinello, G. Salvietti, A. Luca, D. Prattichizzo (2017)
Evaluation of Wearable Haptic Systems for the Fingers in Augmented Reality ApplicationsIEEE Transactions on Haptics, 10
Matanya Horowitz, J. Burdick (2012)
Combined grasp and manipulation planning as a trajectory optimization problem2012 IEEE International Conference on Robotics and Automation
D. Bruemmer, D. Few, R. Boring, J. Marble, Miles Walton, C. Nielsen (2005)
Shared understanding for collaborative controlIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 35
C. Cipriani, F. Zaccone, S. Micera, M. Carrozza (2008)
On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis InteractionIEEE Transactions on Robotics, 24
Marek Kopicki, D. Belter, J. Wyatt (2019)
Learning better generative models for dexterous, single-view grasping of novel objectsThe International Journal of Robotics Research, 38
a 275-g wooden object made of two rectangles having 10 × 2.6 × 4 cm and 11 × 2.6 × 9 cm dimensions (right of Fig. 7)
Nikos Mavrakis, E. AmirM.Ghalamzan, R. Stolkin (2017)
Safe robotic grasping: Minimum impact-force grasp selection2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
C. Pacchierotti, D. Prattichizzo, K. Kuchenbecker (2016)
Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic SurgeryIEEE Transactions on Biomedical Engineering, 63
L. Peternel, T. Petrič, J. Babič (2018)
Robotic assembly solution by human-in-the-loop teaching method based on real-time stiffness modulationAutonomous Robots, 42
Jacob Varley, Chad DeChant, Adam Richardson, J. Ruales, P. Allen (2016)
Shape completion enabled robotic grasping2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Vahid Izadi, Akshay Bhardwaj, A. Ghasemi (2020)
Impedance Modulation for Negotiating Control Authority in a Haptic Shared Control Paradigm2020 American Control Conference (ACC)
Vincent Duchaine, C. Gosselin (2007)
General Model of Human-Robot Cooperation Using a Novel Velocity Based Variable Impedance ControlSecond Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07)
(2015)
Shocking state of world’s riskiest nuclear waste site. https://www.newscientist.com
Joshua Tobin, Wojciech Zaremba, P. Abbeel (2017)
Domain Randomization and Generative Models for Robotic Grasping2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
H. Boessenkool, D. Abbink, C. Heemskerk, F. Helm, Jeroen Wildenbeest (2013)
A Task-Specific Analysis of the Benefit of Haptic Shared Control During TelemanipulationIEEE Transactions on Haptics, 6
Merwan Achibet, M. Marchal, F. Argelaguet, A. Lécuyer (2014)
The Virtual Mitten: A novel interaction paradigm for visuo-haptic manipulation of objects using grip force2014 IEEE Symposium on 3D User Interfaces (3DUI)
Kim Ly, Mithun Poozhiyil, Harit Pandya, G. Neumann, Ayse Kucukyilmaz (2021)
Intent-Aware Predictive Haptic Guidance and its Application to Shared Control Teleoperation2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN)
Bao Xi, Shuo Wang, Xuemei Ye, Yinghao Cai, Tao Lu, Rui Wang (2019)
A robotic shared control teleoperation method based on learning from demonstrationsInternational Journal of Advanced Robotic Systems, 16
Firas Abi-Farraj, C. Pacchierotti, O. Arenz, G. Neumann, P. Giordano (2020)
A Haptic Shared-Control Architecture for Guided Multi-Target Robotic GraspingIEEE Transactions on Haptics, 13
(2011)
Haptic shared control: smoothly shifting control authority?
M. Selvaggio, E. AmirM.Ghalamzan, R. Moccia, F. Ficuciello, B. Siciliano (2019)
Haptic-guided shared control for needle grasping optimization in minimally invasive robotic surgery2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
J. Singh, A. Srinivasan, G. Neumann, Ayse Kucukyilmaz (2020)
Haptic-Guided Teleoperation of a 7-DoF Collaborative Robot Arm With an Identical Twin MasterIEEE Transactions on Haptics, 13
Firas Abi-Farraj, Nicolò Pedemonte, P. Giordano (2016)
A visual-based shared control architecture for remote telemanipulation2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Nathan Ratliff, Matthew Zucker, J. Bagnell, S. Srinivasa (2009)
CHOMP: Gradient optimization techniques for efficient motion planning2009 IEEE International Conference on Robotics and Automation
M. Talha, E. AmirM.Ghalamzan, C. Takahashi, J. Kuo, W. Ingamells, R. Stolkin (2016)
Towards robotic decommissioning of legacy nuclear plant: Results of human-factors experiments with tele-robotic manipulation, and a discussion of challenges and approaches for decommissioning2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)
R. Bogue (2011)
Robots in the nuclear industry: a review of technologies and applicationsInd. Robot, 38
visual guidance, where the subject is shown a graphical representation of the scene indicating the value of H ( o x g ) for each grasp pose using a colour scale (see Fig. 6a)
T. Pardi, V. Ortenzi, C. Fairbairn, Tony Pipe, A. Esfahani, R. Stolkin (2020)
Planning Maximum-Manipulability Cutting PathsIEEE Robotics and Automation Letters, 5
Matthew Zucker, Nathan Google, Anca Dragan, M. Pivtoraiko, Matthew Klingensmith, Nathan Ratliff, Christopher Dellin, J. Bagnell, S. Srinivasa, A. Dragan, S. Srinivasa, Pittsburgh Pa, Philadelphia Pa (2013)
CHOMP: Covariant Hamiltonian optimization for motion planningThe International Journal of Robotics Research, 32
M. Selvaggio, P. Giordano, F. Ficuciello, B. Siciliano (2019)
Passive Task-Prioritized Shared-Control Teleoperation with Haptic Guidance2019 International Conference on Robotics and Automation (ICRA)
E. AmirM.Ghalamzan, Nikos Mavrakis, Marek Kopicki, R. Stolkin, A. Leonardis (2016)
Task-relevant grasp selection: A joint solution to planning grasps and manipulative motion trajectories2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
D. Abbink, M. Mulder, E. Boer (2012)
Haptic shared control: smoothly shifting control authority?Cognition, Technology & Work, 14
(2008)
Giordano received his M.Sc. degree in Computer Science Engineering in 2001, and his Ph.D. degree in Systems Engineering
Dapeng Yang, Hong Liu (2020)
Human-machine shared control: New avenue to dexterous prosthetic hand manipulationScience China Technological Sciences, 64
Haptic-guided Grasping to Minimise Torque Effort during Robotic teleoperation
Rahaf Rahal, Firas Abi-Farraj, P. Giordano, C. Pacchierotti (2019)
Haptic Shared-Control Methods for Robotic Cutting under Nonholonomic Constraints2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
P Abbeel (2010)
1608The International Journal of Robotics Research, 29
Nikos Mavrakis, R. Stolkin, A. Esfahani (2020)
Estimating An Object’s Inertial Parameters By Robotic Pushing: A Data-Driven Approach2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
basic teleoperation, where the subject receives no haptic guidance about suitable grasp poses
DA Abbink (2012)
19Cognition, Technology & Work, 14
M. Selvaggio, Firas Abi-Farraj, C. Pacchierotti, P. Giordano, B. Siciliano (2018)
Haptic-Based Shared-Control Methods for a Dual-Arm SystemIEEE Robotics and Automation Letters, 3
R. Detry, Jeremie Papon, L. Matthies (2017)
Task-oriented grasping with semantic and geometric scene understanding2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
L. Peternel, Cheng Fang, Marco Laghi, A. Bicchi, N. Tsagarakis, A. Ajoudani (2020)
Human Arm Posture Optimisation in Bilateral Teleoperation Through Interface Reconfiguration2020 8th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob)
R. Murray, S. Sastry, Zexiang Li (1994)
A Mathematical Introduction to Robotic Manipulation
a 11 × 11 × 15 cm rectangular lamp of 1958 g with an handle (center of Fig. 7)
B. Nelson, J. Morrow, P. Khosla (1996)
Robotic manipulation using high bandwidth force and vision feedbackMathematical and Computer Modelling, 24
Marco Cognetti, Marco Aggravi, C. Pacchierotti, P. Salaris, P. Giordano (2020)
Perception-Aware Human-Assisted Navigation of Mobile Robots on Persistent TrajectoriesIEEE Robotics and Automation Letters, 5
N. Vahrenkamp, Markus Przybylski, T. Asfour, R. Dillmann (2011)
Bimanual grasp planning2011 11th IEEE-RAS International Conference on Humanoid Robots
C. Pacchierotti (2015)
Cutaneous Haptic Feedback in Robotic Teleoperation
S. Panesar, Y. Cagle, D. Chander, Jose Morey, J. Fernandez-Miranda, M. Kliot (2019)
Artificial Intelligence and the Future of Surgical Robotics.Annals of Surgery
Carlo Masone, P. Giordano, H. Bülthoff, A. Franchi (2014)
Semi-autonomous trajectory generation for mobile robots with integral haptic shared control2014 IEEE International Conference on Robotics and Automation (ICRA)
J. Schulman, Yan Duan, Jonathan Ho, Alex Lee, I. Awwal, H. Bradlow, Jia Pan, S. Patil, Ken Goldberg, P. Abbeel (2014)
Motion planning with sequential convex optimization and convex collision checkingThe International Journal of Robotics Research, 33
A. Franchi, C. Secchi, Markus Ryll, H. Bülthoff, P. Giordano (2012)
Shared Control : Balancing Autonomy and Human Assistance with a Group of Quadrotor UAVsIEEE Robotics & Automation Magazine, 19
P. Abbeel, Adam Coates, A. Ng (2010)
Autonomous Helicopter Aerobatics through Apprenticeship LearningThe International Journal of Robotics Research, 29
S. Levine, P. Pastor, A. Krizhevsky, Deirdre Quillen (2016)
Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collectionThe International Journal of Robotics Research, 37
Petar Kormushev, S. Calinon, D. Caldwell (2011)
Imitation Learning of Positional and Force Skills Demonstrated via Kinesthetic Teaching and Haptic InputAdvanced Robotics, 25
Mavrakis Nikos, E. Amir, Stolkin Rustam, Baronti Luca, Kopicki Marek, Castellani Marco (2016)
Analysis of the inertia and dynamics of grasped objects, for choosing optimal grasps to enable torque-efficient post-grasp manipulations, 2016
Marek Kopicki, R. Detry, Maxime Adjigble, R. Stolkin, A. Leonardis, J. Wyatt (2016)
One-shot learning and generation of dexterous grasps for novel objectsThe International Journal of Robotics Research, 35
L. Baronti, M. Alston, Nikos Mavrakis, A. Esfahani, M. Castellani (2019)
Primitive Shape Fitting in Point Clouds Using the Bees AlgorithmApplied Sciences
Firas Abi-Farraj, Bernd Henze, Alexander Werner, M. Panzirsch, C. Ott, M. Roa (2018)
Humanoid Teleoperation Using Task-Relevant Haptic Feedback2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Francesco Corucci, E. Ruffaldi (2014)
Toward Autonomous Robots for Demolitions in Unstructured Environments
Yuanchao Zhu, Can-jun Yang, Qian-xiao Wei, Xin Wu, Wei Yang (2020)
Human-robot shared control for humanoid manipulator trajectory planningInd. Robot, 47
Stephen James, Paul Wohlhart, Mrinal Kalakrishnan, Dmitry Kalashnikov, A. Irpan, Julian Ibarz, S. Levine, R. Hadsell, Konstantinos Bousmalis (2018)
Sim-To-Real via Sim-To-Sim: Data-Efficient Robotic Grasping via Randomized-To-Canonical Adaptation Networks2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
L. Meli, C. Pacchierotti, G. Salvietti, F. Chinello, Maurizio Maisto, A. Luca, D. Prattichizzo (2018)
Combining Wearable Finger Haptics and Augmented Reality: User Evaluation Using an External Camera and the Microsoft HoloLensIEEE Robotics and Automation Letters, 3
E. AmirM.Ghalamzan, Firas Abi-Farraj, P. Giordano, R. Stolkin (2017)
Human-in-the-loop optimisation: Mixed initiative grasping for optimally facilitating post-grasp manipulative actions2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Soran Parsa, Horia Maior, Alex Thumwood, Max Wilson, Marc Hanheide, A. Esfahani (2022)
The Impact of Motion Scaling and Haptic Guidance on Operators’ Workload and Performance in TeleoperationCHI Conference on Human Factors in Computing Systems Extended Abstracts
Maxime Adjigble, Naresh Marturi, V. Ortenzi, R. Stolkin (2019)
An assisted telemanipulation approach: combining autonomous grasp planning with haptic cues2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
N. Vahrenkamp, T. Asfour, G. Metta, G. Sandini, R. Dillmann (2012)
Manipulability analysis2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012)
L. Meli, C. Pacchierotti, D. Prattichizzo (2017)
Experimental evaluation of magnified haptic feedback for robot‐assisted needle insertion and palpationThe International Journal of Medical Robotics and Computer Assisted Surgery, 13
C. Pacchierotti, F. Ongaro, Frank Brink, ChangKyu Yoon, D. Prattichizzo, D. Gracias, S. Misra (2018)
Steering and Control of Miniaturized Untethered Soft Magnetic Grippers With Haptic AssistanceIEEE Transactions on Automation Science and Engineering, 15
our proposed haptic shared control approach, where the subject receives haptic guidance toward grasp poses locally minimising H ( o x g ) , i.e., the
(2018)
Ph.D. degree from the University of Rennes 1 in 2018
M. Selvaggio, Jonathan Cacace, C. Pacchierotti, Fabio Ruggiero, P. Giordano (2021)
A Shared-Control Teleoperation Architecture for Nonprehensile Object TransportationIEEE Transactions on Robotics, 38
J. Oosterhout, Jeroen Wildenbeest, H. Boessenkool, C. Heemskerk, M. Baar, F. Helm, D. Abbink (2015)
Haptic Shared Control in Tele-Manipulation: Effects of Inaccuracies in Guidance on Task ExecutionIEEE Transactions on Haptics, 8
Yiyang Zhou, Wenhai Wang, Wenjie Guan, Yirui Wu, Heng Lai, Tong Lu, Mingjia Cai (2017)
Visual Robotic Object Grasping Through Combining RGB-D Data and 3D Meshes
L. Rozo, P. Jiménez, C. Torras (2013)
A robot learning from demonstration framework to perform force-based manipulation tasksIntelligent Service Robotics, 6
Andrew Miller, P. Allen (2004)
Graspit! A versatile simulator for robotic graspingIEEE Robotics & Automation Magazine, 11
Rahaf Rahal, Giulia Matarese, M. Gabiccini, Alessio Artoni, D. Prattichizzo, P. Giordano, C. Pacchierotti (2020)
Caring About the Human Operator: Haptic Shared Control for Enhanced User Comfort in Robotic TelemanipulationIEEE Transactions on Haptics, 13
Teleoperating robotic manipulators can be complicated and cognitively demanding for the human operator. Despite these difficulties, teleoperated robotic systems are still popular in several industrial applications, e.g., remote handling of hazardous material. In this context, we present a novel haptic shared control method for minimising the manipulator torque effort during remote manipulative actions in which an operator is assisted in selecting a suitable grasping pose for then displacing an object along a desired trajectory. Minimising torque is important because it reduces the system operating cost and extends the range of objects that can be manipulated. We demonstrate the effectiveness of the proposed approach in a series of representative real-world pick-and-place experiments as well as in a human subjects study. The reported results prove the effectiveness of our shared control vs. a standard teleoperation approach. We also find that haptic-only guidance performs better than visual-only guidance, although combining them together leads to the best overall results.
Autonomous Robots – Springer Journals
Published: Apr 1, 2023
Keywords: Teleoperation; Shared control; Grasping; Haptics; Post-grasp manipulation
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.