Methods To Sense The 3D Surface/Structure Of A Book

DIY Book Scanner Skunk Works. Share your crazy ideas and novel approaches. Home of the "3D structure of a book" thread.

Moderator: peterZ

spamsickle
Posts: 596
Joined: 06 Jun 2009, 23:57

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by spamsickle »

I just got an email that said the ship date for the Leap device was being pushed back to July anyway.

In the Leap forums, someone posted pictures which made it look like it would be possible to get a depth map from the device (although now that I look at it again, it's probably just a stereo view in infrared, rather than a depth map). I think his was 640x480, but he implied that other resolutions might be available. Whether the SDK will ever provide that functionality is another question.

Since we can already generate stereo views of a warped page, I think I'll go back to playing with that. Most pages are nothing but text, which provides lots of features to match. Pages with less features to match probably don't look so warped to begin with.
spamsickle
Posts: 596
Joined: 06 Jun 2009, 23:57

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by spamsickle »

Shaknum wrote:By the way, this new product called the Duo, http://www.kickstarter.com/projects/cod ... -3d-sensor, may be more suited to our usage since it is DIY and very open. I am not sure if it will provide point cloud data, but some statements on the kickstarter page sound like it does/will. Also, we don't know if it can be modded to work with higher resolution cameras.
Probably just a coincidence that the email announcing the pushback to July delivery of the Leap came mere hours after the Duo failed to reach its Kickstarter goal...
diybookscannermember
Posts: 7
Joined: 02 Sep 2010, 13:45
Number of books owned: 0
Country: USA

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by diybookscannermember »

Did someone ask for a way to generate a point cloud?

If any one has some skill in electronics and a desire to follow this a little further, I came across an article at a publication repository for the "Sensor Systems Laboratory" at the University of Washington which had the following article about using an electric field for "pre-touch" sensors on robotic fingers. The direct link to the latest publication is here:
http://sensor.cs.washington.edu/pubs/pretouch_rss12.pdf

Although this shows a point cloud being generated (last page, fig7.a and 7.b), the document above doesn't quite go far enough into depth on the sensor to replicate it, but there is more information (schematics etc.) in some of the earlier publications listed in the "Robotics" section where I found the above article. Here is that publication repository:
http://sensor.cs.washington.edu/publications.html

Specifically some schematics and descriptions of the sensing apperatus used in the teams earlier work can be found here:
http://sensor.cs.washington.edu/pubs/EF ... IROS07.pdf

Hope this helps or inspires in some way.
spamsickle
Posts: 596
Joined: 06 Jun 2009, 23:57

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by spamsickle »

3D Scanning with sub-mm resolution?

"3D imaging systems have recently obtained increased publicity by their use in consumer electronics devices. Applications include gesture recognition or 3D mapping in autonomous cars. Today’s commercially available miniaturized 3D imaging systems are most commonly based on time-of-flight measurements. They are several cm3 in size and offer 10s of cm ranging resolution at a typical object distance of 10m. Frequency Modulated Continuous Wave (FMCW) Light Detection and Ranging (LIDAR) offers significantly better ranging resolution at typical distances of a few meters, without the need of high speed detectors and electronics.

We present recent ranging results with sub-mm resolution in indoor environments using a miniaturized FMCW LIDAR source. Our chip-scale source employs MEMS tunable infrared Vertical Cavity Surface Emitting Lasers (VCSEL), silicon photonics, and control electronics. Using an optoelectronic phase-locked loop employing an integrated silicon photonics chip, we demonstrate generation of linear frequency chirps as frequency modulated ranging signal, exhibiting a tunable VCSEL source frequency excursion of 50GHz at a center wavelength of λ0=1548nm. Design and performance of the source components as well as experimental ranging results will be discussed."

More details here.
"31 μm range resolution at 1.5m has recently been reported"
aku
Posts: 54
Joined: 02 Jan 2010, 08:38
Number of books owned: 0
Country: Germany
Location: Willich, Germany

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by aku »

Came across

http://arstechnica.com/gadgets/2014/10/ ... ns-jarvis/

today. Quoting from the article.
The all-in-one desktop PC has an integrated 3D scanner that can digitize physical objects and a projector with a 20-inch touch-sensitive mat. The 3D scanner uses Intel's RealSense 3D capture, which combines the images from multiple cameras to construct its 3D models; it can also capture 14 megapixel 2D images. Both the 3D scanner and the projector point at the touch mat, creating a workspace enabling the "physical" manipulation of digital objects.
While a not a laser scanner, possibly also able to reconstruct the surface of the book sitting under scanner with good enough a resolution.
vitorio
Posts: 138
Joined: 30 Oct 2010, 23:56
Number of books owned: 0
Location: Austin, Texas, USA
Contact:

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by vitorio »

aku wrote: 29 Oct 2014, 17:56 Came across

http://arstechnica.com/gadgets/2014/10/ ... ns-jarvis/

today. Quoting from the article.
The all-in-one desktop PC has an integrated 3D scanner that can digitize physical objects and a projector with a 20-inch touch-sensitive mat. The 3D scanner uses Intel's RealSense 3D capture, which combines the images from multiple cameras to construct its 3D models; it can also capture 14 megapixel 2D images. Both the 3D scanner and the projector point at the touch mat, creating a workspace enabling the "physical" manipulation of digital objects.
While a not a laser scanner, possibly also able to reconstruct the surface of the book sitting under scanner with good enough a resolution.
The overhead 3D scanner is now available standalone as the HP Z 3D camera: http://www8.hp.com/us/en/campaigns/z-3d ... rview.html

$599, releases in March 2018
aku
Posts: 54
Joined: 02 Jan 2010, 08:38
Number of books owned: 0
Country: Germany
Location: Willich, Germany

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by aku »

vitorio wrote: 25 Jan 2018, 17:31
aku wrote: 29 Oct 2014, 17:56 Came across

http://arstechnica.com/gadgets/2014/10/ ... ns-jarvis/

While a not a laser scanner, possibly also able to reconstruct the surface of the book sitting under scanner with good enough a resolution.
The overhead 3D scanner is now available standalone as the HP Z 3D camera: http://www8.hp.com/us/en/campaigns/z-3d ... rview.html

$599, releases in March 2018
8-page PDF (460K) Quickview
3D resolution: 2~5mm, for depth sensing range 30cm ~ 120cm
3D point accuracy: 2~10 mm relative depth accuracy within depth sensing range
The resolution might give us a rough shape, I believe. The (non-)accuracy seems to eclipse the resolution something fierce however. See also
3D Scan Limitations
* Not intended for detailed 3D reproduction
* Only rigid parts can be 3D scanned
* Black, shiny, transparent, glossy and highly reflective surfaces have 3D scan limitations and are not recommended
Under requirements is
NVIDIA® GeForce® GTX 960M or better NVIDIA graphics card required for 3D capture
So I guess that their software offloads the complex calculations to the GPU.
And the software requires Windows 10.

I guess basic Linux support will be easy to hack up for the people with experience (Kinect/Linux hackers?). The 3D support I suspect to take(much) longer.
User avatar
daniel_reetz
Posts: 2812
Joined: 03 Jun 2009, 13:56
E-book readers owned: Used to have a PRS-500
Number of books owned: 600
Country: United States
Contact:

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by daniel_reetz »

Looks a bit like another Kinect derivative. I still think structured light solutions (projector-camera) are the way to go.
aku
Posts: 54
Joined: 02 Jan 2010, 08:38
Number of books owned: 0
Country: Germany
Location: Willich, Germany

Re: Methods To Sense The 3D Surface/Structure Of A Book

Post by aku »

daniel_reetz wrote: 27 Jan 2018, 17:55 Looks a bit like another Kinect derivative. I still think structured light solutions (projector-camera) are the way to go.
As far as I can tell from the datasheet this is a structured light scanner (as is the Kinect).

A moment ... Page 6:
Scanning technology
3D depth sensing camera (IR Diffractive Optical Element Projector)
Post Reply