Tactile Sensing & Robot E-Skin: The Ultimate Guide
How robots feel: capacitive, piezoresistive, magnetic and optical tactile sensing, slip detection, and the wiring problem behind whole-body e-skin.
Cover your eyes and pick a key out of your pocket. You will find it, orient it, and slot it into a lock without a single glance, because your fingertips are reporting contact location, pressure, edges, and the first micron of slip faster than your visual system could ever close the loop. Robots that manipulate the world are trying to recover that channel. A camera watching a gripper close on a wine glass sees the fingers approach and touch, but it cannot see the contact pressure, cannot feel the glass beginning to slide, and is fully occluded at the exact moment the grasp is decided. Touch is the sense that reports on physical contact after vision has run out of useful information.
This guide is about the hardware and physics of robot touch: the transducers that turn contact force into an electrical signal, the sensing principles behind them (capacitive, resistive, piezoresistive, piezoelectric, magnetic, and optical), the difference between a dense fingertip sensor and a sheet of electronic skin stretched over a whole arm, and the signals touch delivers that no other sensor can: where the contact is, how force is distributed across the contact patch, whether the object is slipping, and what its surface texture feels like. We will get concrete about spatial resolution, bandwidth, and the wiring nightmare that keeps whole-body e-skin in the lab, and about real systems: GelSight and DIGIT on the optical side, the barometric and capacitive taxel arrays on production grippers, SynTouch's BioTac, and the dense skins coming out of research groups building humanoid hands.
The take: touch is the sensing modality that closes the loop on contact, and every serious manipulation robot eventually needs it, because vision goes blind exactly when fingers meet object. The transducer principle you pick (capacitive, piezoresistive, magnetic, optical) trades spatial resolution, bandwidth, robustness, and wiring density against each other, and there is no universal winner. The hard part is rarely sensing a single press. It is fusing hundreds or thousands of noisy, drifting, temperature-sensitive channels into a real-time contact estimate, and routing their wires off a moving, articulated hand without the cabling becoming the failure mode.
Companion reading: robot sensors, end-effectors & grippers, humanoid robot hardware, soft robotics, and robot perception & pose estimation.
Table of contents
- Key takeaways
- Why touch matters for manipulation
- What a tactile sensor actually measures
- The transducer families and their physics
- Optical tactile: GelSight, DIGIT, and the camera-in-a-fingertip
- Fingertip sensors vs large-area electronic skin
- Slip detection: the killer app
- Spatial resolution, bandwidth, and the specs that matter
- Calibration, drift, and the error sources
- Wiring and integration: the whole-body problem
- Applications: hands, humanoids, prosthetics
- Selecting a tactile sensor
- Frequently asked questions
Why touch matters for manipulation
Manipulation is control of contact, and you cannot control what you cannot measure. Consider the sequence of picking up a paper cup of coffee. Vision gets the gripper close and roughly aligned, then the fingers occlude the cup and the camera is done. From that instant the useful information is all tactile: did both fingers make contact, is the force high enough to hold but low enough not to crush, is the cup slipping down as its weight loads the grasp, is it tilting because one finger landed higher than the other. Every one of those is a contact measurement, and none of them is visible.
This is the deep reason touch keeps returning to the top of the manipulation research agenda. For decades the field tried to solve grasping as a geometry problem: perceive the object, compute a stable grasp, execute open-loop. It works in a structured cell with known parts. It falls apart on deformable objects, unknown objects, cluttered bins, and anything where the contact state at closure differs from the plan. The recovery from a bad grasp, and the fine adjustments that turn a marginal grasp into a secure one, live in the tactile loop. A robot with touch regrasps, reorients in-hand, and controls force. A robot without it commits to whatever the vision system guessed and hopes.
Biology makes the same argument by construction. The human hand carries roughly 17,000 mechanoreceptors, four types with different spatial and temporal tuning, densest at the fingertips where two-point discrimination reaches about 1 mm. That density earns its keep. Anaesthetize a fingertip and dexterity collapses even with vision intact: you drop objects, you crush fragile ones, you cannot find the edge of a coin in your palm. Touch is what lets the hand apply exactly the force a task needs and adapt within milliseconds when contact changes.
Rule of thumb: if a task involves controlling force, handling deformable or fragile objects, grasping unknown items, or manipulating in-hand, budget for tactile sensing. If the robot only has to move known rigid parts along known trajectories in a fixture, you may get away with pure position control. See the end-effectors & grippers guide.
What a tactile sensor actually measures
The word "tactile" hides a stack of distinct physical quantities, and a sensor that measures one may be blind to the others. Being precise about what you need is the first step in selection.
Normal force (pressure perpendicular to the skin) is the easiest and most common measurement. A single taxel (tactile element, the pixel of a touch sensor) under load reports how hard something presses on it. An array of taxels gives a pressure distribution: a map of how force spreads across the contact patch, which encodes contact area, the shape of the pressing object, and where the centroid of pressure sits.
Shear force (tangential force, parallel to the skin) is much harder and much more valuable. Shear is what resists an object sliding out of a grasp, so measuring it is central to slip detection and to controlling the friction cone. A pressure-only sensor is blind to shear: you can press straight down or drag sideways and a bare pressure taxel cannot tell the difference. Recovering the full three-axis force at a contact (normal plus two shear components) is what separates a premium tactile sensor from a cheap one.
Contact location falls out of an array: which taxels are loaded tells you where on the finger the contact sits, which the robot needs to reason about grasp geometry and in-hand object pose.
Vibration and dynamic events live in the high-frequency band. When a fingertip slides across a textured surface, or when an object begins to slip, the contact generates micro-vibrations in the tens to hundreds of hertz. Catching these requires a sensor with real bandwidth, and it is exactly what a slow, DC-coupled pressure array misses. Slip and texture are dynamic signals.
Temperature and heat flux encode material properties. A metal object pulls heat from a warm fingertip faster than a wooden one, and a sensor that measures heat flux can tell them apart. This is a niche modality, used in material recognition and in biomimetic fingertips like the BioTac.
A useful mental split: static tactile (normal pressure distribution, contact location, slowly varying force) versus dynamic tactile (shear onset, slip, vibration, texture). Cheap arrays do static well and dynamic poorly. Piezoelectric and optical sensors do dynamic well. The best sensors do both, and pay for it in cost and complexity.
The transducer families and their physics
Every electronic tactile sensor turns mechanical deformation into an electrical change through one of a handful of physical effects. Understanding the effect tells you the sensor's native strengths and its unavoidable weaknesses.
Resistive and piezoresistive
The simplest family. A force-sensitive resistor (FSR) is a polymer film whose bulk or contact resistance drops as you press it, because pressure pushes conductive particles closer together and multiplies the microscopic contact points between the film and its electrodes. Cheap, thin, and trivial to read (a voltage divider and an ADC), FSRs are everywhere in low-cost robotics. The physics also sets their limits: the resistance-to-force curve is nonlinear and highly hysteretic (the reading depends on whether you are loading or unloading), it drifts under sustained load, and repeatability is poor. FSRs are good for coarse presence and rough grip-force thresholds, weak for accurate force.
Piezoresistive sensors use the same idea with better materials: a semiconductor or a conductive composite whose resistance changes with strain via ΔR/R = GF · ε, where the gauge factor GF can reach tens or hundreds in doped silicon (against about 2 for metal foil). MEMS piezoresistive arrays micromachine this into dense, high-resolution grids. The trade is fragility and cost: silicon does not like impacts, and a dense MEMS array is expensive.
Capacitive
A capacitive taxel is a parallel-plate capacitor, C = ε·A/d, with a compressible dielectric (usually a soft elastomer or an air gap) between the plates. Press it and the plate spacing d shrinks, so capacitance rises; a shear force that slides the plates laterally changes the overlap area A, which is how a cleverly patterned capacitive sensor recovers shear as well as normal force. Capacitive sensing is sensitive, low-power, and scales well into arrays, which is why it dominates commercial tactile skins and touchscreens alike. Its weaknesses are electrical: capacitance is tiny (femtofarads to picofarads), so the readout is susceptible to electromagnetic interference and to stray capacitance from a nearby hand or grounded object, and it needs careful shielding and guard electrodes. Temperature also shifts the dielectric constant. Well-engineered capacitive arrays are the workhorse of production e-skin.
Piezoelectric
A piezoelectric material (PVDF polymer film, or a ceramic like PZT) generates a charge when it is deformed, Q = d · F, where d is the piezoelectric coefficient. The signal is proportional to the rate of deformation, so piezoelectric sensors are inherently AC-coupled: they respond brilliantly to dynamic events (an impact, a vibration, the onset of slip) and produce no output at all under a constant static load, because a steady force generates no changing charge. That property makes them the natural dynamic tactile sensor, excellent for detecting the high-frequency signature of slip and for reading texture as a fingertip slides. They are useless for measuring how hard you are holding something at rest. In practice piezoelectric elements are paired with a static sensor (capacitive or resistive) to cover both bands, mirroring the fast and slow mechanoreceptor split in human skin.
Magnetic
A magnetic tactile sensor embeds a small magnet (or a magnetized film) in a soft elastomer above a magnetometer chip (a Hall-effect or magnetoresistive sensor). Press or shear the elastomer and the magnet moves relative to the sensor; the change in the measured field vector recovers the full three-axis displacement, and hence three-axis force, from a single cheap chip. This is the trick behind sensors like the uSkin and the open-source ReSkin: they get shear sensing almost for free, because a magnetometer natively measures a 3D vector. Magnetic sensing is robust (the sensing surface is just a passive elastomer with no embedded electronics, so it is cheap to replace when it wears), low-latency, and immune to the surface contamination that plagues resistive sensors. The catches are cross-sensitivity to external magnetic fields (motors and currents nearby) and the calibration burden of mapping a nonlinear field-to-force relationship, often done now by training a small neural network per sensor.
Barometric
A pragmatic favorite on production grippers: put a tiny MEMS barometric pressure sensor (the same part that measures air pressure for a phone altimeter) under a cast elastomer dome. Load the dome and it pressurizes the sealed fluid or air pocket over the sensor, which reads the force. Each barometric sensor is one taxel, so spatial resolution is coarse (limited by how many discrete chips you can pack), but the parts are cheap, robust, factory-calibrated, and easy to read over I2C. This is how many commercial gripper fingertips get affordable, reliable grip-force sensing without the drift of an FSR.
| Family | Principle | Strengths | Weaknesses |
|---|---|---|---|
| Resistive (FSR) | Pressure lowers contact resistance | Cheapest, thin, simple readout | Hysteresis, drift, poor accuracy, no shear |
| Piezoresistive (MEMS) | Strain changes resistance | High spatial resolution | Fragile, expensive |
| Capacitive | Compression changes plate gap/area | Sensitive, low power, scales to arrays, can sense shear | EMI/stray capacitance, temperature drift |
| Piezoelectric (PVDF/PZT) | Deformation rate generates charge | Excellent dynamic/vibration/slip; high bandwidth | No static output; needs pairing |
| Magnetic (Hall) | Magnet moves over field sensor | 3-axis force cheaply, robust, replaceable skin | External-field sensitivity, nonlinear calibration |
| Barometric | MEMS pressure under elastomer dome | Cheap, robust, factory-calibrated | One chip per taxel, coarse resolution |
| Optical (camera) | Camera images gel deformation | Densest, metric geometry, shear, slip, texture | Bulky, latency, compute-heavy |
Optical tactile: GelSight, DIGIT, and the camera-in-a-fingertip
The richest tactile data of the last decade comes from putting a small camera inside a soft, coated gel and watching how the gel deforms. The approach was pioneered by Johnson and Adelson at MIT ("Retrographic sensing for the measurement of surface texture and shape," CVPR 2009), and the canonical implementation is GelSight.
The construction is a small camera looking up through a transparent elastomer pad at its underside, illuminated from several directions by different-colored LEDs. The move that makes it work is an opaque metallic or matte coating on the gel's outer face. That coating turns a squishy transparent membrane into a surface with known, uniform reflectance, which strips the object's own color and texture out of the image and leaves pure geometry. Light the coated surface from three or more directions with distinctly colored LEDs and you have a photometric stereo rig: each pixel's RGB triple encodes the local surface normal, and integrating the field of normals reconstructs a height map. Because the sensor owns both its lighting and its reflectance, the reconstruction reaches sub-10-micron depth resolution. You can read the embossed text on a coin, measure a chamfer, and see the exact shape of the contact patch.
Slip and shear come from tracking. Print or embed a grid of markers in the gel and track their motion frame to frame: the marker field shears when a tangential force loads the contact, and it starts to slide locally at the onset of slip, well before the object visibly moves. The bulk deformation of the whole gel estimates the contact wrench. One camera delivers geometry, contact area, three-axis force field, and slip, a density no electrode array matches.
The reference designs are the original MIT GelSight, the compact commercial GelSight Mini, and Meta's open-source DIGIT sensor, which put a fingertip-scale optical tactile sensor into wide research use. Newer variants (GelSlim, DenseTact, and 360-degree finger-shaped designs) shrink the package and wrap the sensing surface around a curved fingertip.
The trade-offs are the reason optical tactile has not taken over production grippers. A camera-in-a-fingertip is bulky compared to a thin electrode film, it adds latency of tens of milliseconds (a camera frame plus the image processing), it needs real compute (often a GPU) to run the reconstruction and marker tracking at rate, and the gel wears: the soft coated surface abrades, tears, and must be recast or swapped periodically. For research-grade dexterity the data richness justifies all of it. For a factory gripper that must run untended for a year, a robust electrode array usually wins.
Rule of thumb: reach for optical tactile (GelSight, DIGIT) when the goal is dexterity research, fine geometry, in-hand pose, or high-fidelity slip, and you can absorb the bulk, latency, and compute. Reach for electrode arrays when you need thin, robust, low-latency contact sensing that survives a production duty cycle.
Fingertip sensors vs large-area electronic skin
Tactile hardware splits into two design regimes with different goals, and conflating them is a common planning error.
Fingertip sensors are small, dense, high-performance patches concentrated where the action is: the pads of a gripper or a dexterous hand. Here you want the best spatial resolution, shear sensing, and bandwidth you can get, over a few square centimeters. This is where optical sensors, dense capacitive arrays, and multimodal fingertips like the BioTac live. The engineering optimizes for signal quality because the area is small and the wiring is short.
Large-area electronic skin covers big, curved, moving surfaces: an arm, a torso, a whole robot. The goals invert. Spatial resolution can be coarse (you do not need micron geometry on a forearm), but the skin must be conformable (stretch and bend over compound curves and joints), robust (survive impacts and abrasion), and above all wireable (get thousands of channels off a moving body). Large-area skin is dominated by low-resolution capacitive and piezoresistive designs precisely because they can be made thin, flexible, and multiplexable. Its primary jobs are contact presence, collision detection, and safe human contact, not fine manipulation.
The distinction maps onto biology. Your fingertips are dense (about 1 mm resolution) and your back is coarse (two-point discrimination of several centimeters), and the wiring density follows: the somatosensory cortex devotes enormous area to the hands and little to the back. A robot allocates its tactile budget the same way, dense where it manipulates, sparse where it merely needs to know it was touched.
A whole capable robot uses both: high-density fingertip sensors for manipulation and low-density skin over the arms and body for safe contact and whole-body awareness. See the humanoid robot hardware guide for how the two combine on a full platform, and the soft robotics guide for the stretchable-substrate approaches that make conformable skin possible.
Slip detection: the killer app
If you had to justify tactile sensing with one capability, it would be slip detection, because it is the thing nothing else can do and the thing that most directly prevents dropped objects.
Slip is the object beginning to slide within the grasp, and it comes in two flavors. Gross slip is the whole object moving, by which point you are already losing it. Incipient slip is the interesting one: a partial slip that starts at the edge of the contact patch while the center still sticks, a physical precursor that appears before the object visibly moves. Catching incipient slip lets the robot tighten its grip in time. Miss it and you get gross slip and a dropped object.
The physics: a grasp holds as long as the tangential force stays inside the friction cone, F_tangential <= mu · F_normal. As an object's weight loads the grasp, or as an external force tugs it, the tangential demand rises. When it approaches the friction limit, the contact patch starts to partially slide from its periphery inward, generating a characteristic micro-vibration and a measurable shift in the shear field. A tactile sensor that measures shear (magnetic, optical, or a shear-sensitive capacitive design) sees the shear field grow and then start to slide; a sensor with high bandwidth (piezoelectric, or an optical sensor tracking markers) catches the vibration signature.
This is exactly where a wrist force/torque sensor falls short. A wrist sensor sees the net wrench at the tool and can tell that grip force dropped, but it cannot localize the slip or catch the incipient stage at the contact patch, because it averages over the whole contact. The tactile sensor sits at the contact and sees the shear field directly. The standard control response is a reflex: on detecting incipient slip, increase grip force by a margin above the friction requirement, the same thing your own hand does automatically when a glass starts to slide.
War story: a bin-picking cell kept dropping smooth plastic bottles a second or two after a confident grasp. The wrist force/torque sensor read a stable grip the whole way, right up to the moment the bottle hit the floor, because by the time the net force changed the bottle was already gone. Adding a shear-sensing fingertip pad exposed the real story: the shear field was creeping toward the friction limit from the instant of lift, and the periphery of the contact patch was already micro-sliding. A simple slip reflex that bumped grip force on rising shear fixed it. The wrist sensor had never been lying; it was averaging over a contact whose edges were failing while its center still held.
Spatial resolution, bandwidth, and the specs that matter
Tactile datasheets are less standardized than IMU or camera datasheets, which makes reading them harder. These are the parameters that decide whether a sensor fits a task.
Spatial resolution is the taxel pitch, the center-to-center spacing of sensing elements, and it sets the smallest contact feature you can localize. Human fingertips resolve about 1 mm. Production tactile arrays run coarser, a few millimeters per taxel, while optical sensors resolve tens of microns of geometry (a different and finer thing than taxel pitch, because they reconstruct a continuous height map rather than sampling discrete points). Match resolution to the smallest feature the task requires: edge detection on a coin needs sub-millimeter; sensing that a box is in the grip needs centimeters.
Force range and resolution frame the pressure axis. Grasping delicate objects needs sensitivity down to a fraction of a newton; heavy industrial grips need tens of newtons of range. As with any sensor, a wide range spent on a small task wastes resolution. Check the minimum detectable force and the full-scale range together.
Bandwidth is the frequency of contact events the sensor tracks. This is the spec that separates static from dynamic sensing. A DC-coupled pressure array might update at tens of hertz, fine for grip force, useless for slip. Catching slip and texture needs bandwidth into the hundreds of hertz, which is why piezoelectric and optical sensors, or a dedicated high-rate channel, are needed for dynamic tasks. Human Pacinian corpuscles respond past 400 Hz, a useful target for a fingertip that must feel texture.
Number of taxels and channel count drives everything downstream: wiring, readout electronics, and the compute to fuse the data. A 4x4 fingertip pad is trivial; a hand with thousands of taxels is a data-acquisition project.
Shear capability is a yes/no that changes the sensor class and the price. Pressure-only is cheap and common; three-axis force per taxel is premium and is what you need for slip and dexterous manipulation.
Hysteresis, drift, and repeatability are where soft tactile sensors disappoint. Because the transduction runs through a soft elastomer that visco-elastically relaxes, the reading depends on loading history (hysteresis), climbs under sustained load (creep), and shifts with temperature. A sensor with a beautiful sensitivity number and 20% hysteresis is hard to use for accurate force.
Durability is a real spec for a device that gets pressed, dragged, and impacted thousands of times a day. Elastomer surfaces wear and tear; the mean time before a gel or skin must be replaced is a maintenance line item.
Rule of thumb: decide first whether the task is static (grip force, contact presence) or dynamic (slip, texture). Static tasks tolerate cheap DC arrays; dynamic tasks demand bandwidth and usually shear. Buying a high-resolution static array and expecting it to catch slip is the most common tactile mistake.
Calibration, drift, and the error sources
A raw tactile signal is close to useless until it is calibrated, and the calibration is harder and less stable than for stiffer sensors, because the transduction path runs through soft, viscoelastic, temperature-sensitive materials.
Per-taxel gain and offset variation is the first problem. In an array of hundreds of nominally identical taxels, manufacturing spread means each has a slightly different sensitivity and zero. Every taxel needs its own calibration, and a factory-calibrated array ships with a per-element correction map, much as a force/torque sensor ships with its calibration matrix.
Nonlinearity is pervasive. FSR resistance-versus-force is steeply nonlinear; magnetic field-versus-displacement is nonlinear; optical gel deformation is nonlinear near saturation. Modern practice increasingly fits these with a small per-sensor neural network trained against a reference force, especially for magnetic and optical sensors where a closed-form model is intractable.
Hysteresis means the output depends on whether you are loading or unloading, so the same force reads differently depending on history. It comes straight from the elastomer's viscoelasticity and cannot be fully calibrated out, only characterized and bounded.
Creep is the output drifting under a constant sustained load as the elastomer slowly relaxes, over seconds to minutes. A robot holding an object with a "constant" grip sees its tactile reading wander even though nothing mechanical changed.
Temperature sensitivity shifts nearly everything: the dielectric constant of a capacitive sensor, the resistance of a piezoresistor, the modulus of the elastomer itself, and the offset of a magnetometer. A fingertip warmed by a nearby motor or by ambient change re-zeros itself out from under you. Robust designs measure temperature and compensate, or re-zero frequently.
Zero drift and the need to re-bias follow from all of the above. The practical discipline is the same as with a force/torque sensor: re-zero the tactile sensor when it is known to be untouched, immediately before a contact task, so that creep and thermal drift do not masquerade as contact force.
External interference is family-specific: capacitive sensors pick up stray capacitance from nearby grounded objects and electromagnetic noise; magnetic sensors pick up motor and current fields. Both need shielding, guarding, or field compensation.
The honest summary is that tactile calibration is an ongoing burden that recurs long after the factory step, because the sensing surface ages, wears, and lives in a thermally and electrically noisy environment on a moving robot. Budget for periodic recalibration and frequent re-zeroing, and prefer sensors whose sensing surface is a cheap, replaceable, passive element (magnetic and optical designs score well here).
Wiring and integration: the whole-body problem
The reason your arm is covered in skin and your robot is not is wiring. Sensing a single press is easy. Getting the signals from thousands of taxels, distributed over a moving, articulated, impact-prone body, into a computer at real-time rates, is the problem that keeps whole-body e-skin in the lab.
Start with the arithmetic. Approach human fingertip density (about 1 mm pitch) over a hand's worth of area and you are into the thousands of taxels; cover a humanoid's whole body and the count reaches tens of thousands. Running one wire per taxel is impossible, so tactile skin is multiplexed: taxels are addressed in a row-and-column matrix (like a keyboard or a display), which cuts N taxels from N wires to about 2·sqrt(N). Matrix addressing brings its own problem, crosstalk: current sneaks through unintended paths in the resistor grid (the "ghosting" that plagues resistive matrices), so the readout needs active isolation (a diode or transistor per taxel, or a driven-guard scheme) to read one element cleanly.
The modern architecture pushes intelligence to the edge. Rather than route raw analog signals across a flexing body to a central ADC, capable e-skins digitize locally: small microcontrollers or ASICs embedded in patches of skin sample their local taxels, digitize, and put the data on a shared serial bus. This is the approach behind mature research skins such as the modular hexagonal cells developed at the Technical University of Munich, where each patch carries its own local sensing and communication, tiles a surface, and daisy-chains onto a network. Local digitization solves noise (you move bits, not microvolts, across the body) and drastically reduces wire count (a bus, not a bundle).
Then there is the mechanical reality that the wires and the skin move and wear. Every conductor crossing a joint flexes millions of cycles and must survive it; the skin abrades against the world and takes impacts. This forces stretchable substrates (see the soft robotics guide), serpentine conductor traces that tolerate strain, and connectors that do not fatigue. A tactile system that works on the bench and cracks a trace after a week of arm motion has solved the easy half of the problem.
Finally, compute and bandwidth. Tens of thousands of taxels at a useful update rate is a real data stream, and fusing it into a whole-body contact estimate in real time is a nontrivial perception load. This is where tactile meets the rest of the stack: the raw contact data feeds pose estimation, grasp control, and collision response (see the robot perception & pose estimation guide).
Rule of thumb: when you scope whole-body or whole-hand tactile, treat wiring, local digitization, connector durability, and network bandwidth as the primary design problem, and the transducer choice as secondary. The failure mode of dense e-skin is almost always a broken wire or a saturated bus, with the taxel itself rarely at fault.
Applications: hands, humanoids, prosthetics
Dexterous robot hands are the flagship use. A multi-fingered hand doing in-hand manipulation (reorienting an object between its fingers, finding a grasp on an unknown item, inserting a part) lives or dies on tactile feedback, because the contact state changes constantly and vision is occluded by the fingers. Research hands increasingly carry dense tactile fingertips, and the manipulation policies that run on them (often learned) treat touch as a primary input alongside vision. See the end-effectors & grippers guide.
Humanoids need touch at two scales at once: dense fingertips for manipulation and coarse whole-body skin for safe contact and whole-body awareness. A humanoid working near people must know when and where its arm or torso brushes a person or the environment, which is a large-area contact-detection problem that also serves functional safety. The dense-hand-plus-sparse-body allocation described earlier is the natural architecture, and it is a defining integration challenge of the current generation of humanoids. See the humanoid robot hardware guide.
Prosthetics invert the direction of the tactile channel. A prosthetic hand uses tactile sensing both to control grip (the same slip and force control a robot needs) and, in advanced systems, to provide sensory feedback to the user, encoding fingertip contact and force into nerve stimulation or vibrotactile cues so the wearer feels the object. Restoring touch measurably improves control and embodiment, and it is one of the most human-facing applications of the whole field.
Industrial gripping is the mature, deployed end. Barometric and capacitive fingertip pads on commercial grippers provide grip-force feedback and slip detection for pick-and-place, packaging, and assembly, where they turn a blind pinch into a controlled grasp. This is where tactile sensing already earns its keep in production today.
Material and texture recognition is a smaller but real niche: a fingertip that slides across a surface and reads the vibration and heat-flux signature can classify materials, useful in sorting, inspection, and research. The multimodal BioTac (pressure, vibration, and thermal) is the reference sensor for this.
Selecting a tactile sensor
Choose in this order, each criterion narrowing the field before the next.
- Static or dynamic? If the task is grip force and contact presence, a DC pressure array (barometric, capacitive, resistive) is enough. If it involves slip, texture, or fast contact events, you need bandwidth and almost certainly shear: piezoelectric, magnetic, or optical.
- Do you need shear? Slip detection and dexterous manipulation need three-axis force. That eliminates pressure-only arrays and points you at magnetic, optical, or shear-sensitive capacitive designs.
- Resolution required. Fine geometry and edges (coin reading, small-feature inspection): optical. Localizing which finger region touched: a few-millimeter array. Just knowing contact happened: a single taxel or a coarse patch.
- Fingertip or large-area? Small, dense, high-performance patch on a gripper: fingertip-class sensor. Conformable coverage over an arm or body: large-area flexible skin, coarse resolution, wireable.
- Robustness and duty cycle. A production cell running untended favors robust electrode arrays with replaceable passive surfaces (barometric, magnetic). A research bench tolerates a wearing gel for the data richness (optical).
- Wiring and compute budget. Count the channels and be honest about whether you can route and process them. A dense hand or whole-body skin is a data-acquisition and networking project before it is a sensing one.
- Latency. A tight force-control loop cannot afford the tens of milliseconds an optical sensor adds. Electrode arrays are low-latency; camera-based sensors are not.
Rule of thumb: pick the transducer for the one capability that binds your task (usually shear-for-slip, or resolution-for-geometry, or robustness-for-production), then verify the wiring and compute are tractable at your channel count. A sensor that is perfect on every axis except the one your task needs, or that you cannot wire, is the wrong sensor.
Frequently asked questions
Do I need tactile sensing if I already have a good vision system and a force/torque sensor? For contact-controlled manipulation, usually yes. Vision is occluded by the gripper at the moment of grasp and is blind to contact force. A wrist force/torque sensor sees the net wrench but cannot localize contact or catch incipient slip at the patch. Tactile fills exactly that gap: local contact location, pressure distribution, shear, and slip. If your task is moving known rigid parts along fixed paths, you may not need it.
What is the difference between a taxel and a tactile sensor? A taxel (tactile element) is one sensing point, the pixel of touch. A tactile sensor is usually an array of taxels plus its readout electronics. Spatial resolution is the taxel pitch; channel count is the number of taxels.
Why is measuring shear so much harder than measuring pressure? Pressure is a single scalar (force perpendicular to the surface) and most transducers respond to it natively. Shear is tangential force, which requires the sensor to distinguish the direction of a lateral load rather than only its presence. That needs a design that resolves motion in the plane (patterned capacitive electrodes, a moving magnet over a magnetometer, or tracked markers in a gel), which is more complex and more expensive. Shear is also what you need for slip, which is why shear-capable sensors command a premium.
Which tactile technology gives the best data? Optical (camera-based) sensors like GelSight and DIGIT give the richest and most metric data: sub-10-micron geometry, a full deformation field, shear, and slip from one camera. The cost is bulk, tens of milliseconds of latency, a GPU to process it, and a gel that wears. For raw information density nothing else is close; for production robustness electrode arrays usually win.
How does a robot detect slip?
By watching the shear field and the high-frequency vibration at the contact. As tangential force approaches the friction limit (F_tangential = mu · F_normal), the contact patch starts to partially slide from its edges (incipient slip) before the object visibly moves, generating a shear shift and a micro-vibration. A shear-sensing or high-bandwidth tactile sensor catches this and the controller reflexively increases grip force. A wrist force/torque sensor cannot, because it averages over the whole contact and only sees gross slip once the object is already going.
Why do tactile readings drift even when nothing is touching the sensor? Temperature and creep. The soft elastomer and the transducer are temperature-sensitive (a warming motor nearby shifts the zero), and the elastomer viscoelastically relaxes over time. The practical fix is to re-zero the sensor immediately before a contact task when it is known to be untouched, and to temperature-compensate if the sensor supports it.
Why is whole-body robot skin still rare when the sensors themselves are cheap? Wiring, durability, and compute dominate, well ahead of the transducer. Covering a body at useful density means tens of thousands of taxels, which forces matrix multiplexing, local digitization, and a network fabric, plus conductors that survive millions of joint-flex cycles and repeated impact, plus the compute to fuse it all in real time. Those are the hard problems, and they are why dense e-skin lives mostly in research labs while fingertip tactile ships on commercial grippers.
Can tactile sensors handle impacts and rough industrial use? It depends on the family. Optical gels and MEMS piezoresistive arrays are relatively fragile and wear. Barometric and magnetic designs are robust because the sensing surface is a passive, replaceable elastomer with the delicate electronics protected underneath. For a rough duty cycle, favor a design with a cheap replaceable surface and shielded electronics.
What resolution do I actually need? Match it to the smallest feature the task requires. Reading fine geometry (a coin, a small chamfer) needs sub-millimeter, which in practice means an optical sensor. Localizing which region of a fingertip made contact needs a few millimeters. Confirming that an object is in the grip needs only a single taxel or a coarse patch. Higher resolution means more channels, more wiring, and more compute, so do not over-buy it.
How do tactile signals get fused with the rest of the robot's sensing? The contact estimate (location, force, slip) feeds the grasp controller and, on a dexterous hand, the in-hand pose estimator, alongside vision and joint sensing. On a whole body it also feeds collision response and safety. The fusion is the same discipline as any multi-sensor system: consistent timestamps, a correct transform from each sensor to the robot frame, and a model of each sensor's noise. See the robot perception & pose estimation guide.