Knowledge

Photometric stereo

Source đź“ť

675:
surface, and the amount of reflection into the camera is measured. Using this information, a look-up table can be created that maps reflected intensities for each light source to a list of possible normal vectors. This puts constraints on the possible normal vectors the surface may have, and reduces the photometric stereo problem to an interpolation between measurements. Typical known surfaces to calibrate the look-up table with are spheres for their wide variety of surface orientations.
38: 60:). It is based on the fact that the amount of light reflected by a surface is dependent on the orientation of the surface in relation to the light source and the observer. By measuring the amount of light reflected into a camera, the space of possible surface orientations is limited. Given enough light sources from different angles, the surface orientation may be constrained to a single orientation or even overconstrained. 678:
Restricting the BRDF to be symmetrical. If the BRDF is symmetrical, the direction of the light can be restricted to a cone about the direction to the camera. Which cone this is depends on the BRDF itself, the normal vector of the surface, and the measured intensity. Given enough measured intensities
674:
Determine the explicit BRDF prior to scanning. To do this, a different surface is required that has the same or a very similar BRDF, of which the actual geometry (or at least the normal vectors for many points on the surface) is already known. The lights are then individually shone upon the known
669:
surfaces. Some techniques have been developed to model (almost) general BRDFs. In practice, all of these require many light sources to obtain reliable data. These are methods in which surfaces with general BRDFs can be measured.
768: 644:. Computer vision followed a similar course with photometric stereo. Specular reflections were among the first deviations from the Lambertian model. These are a few adaptations that have been developed. 652:. The reflected light intensities towards the camera is measured, and the inverse reflectance function is fit onto the measured intensities, resulting in a unique solution for the normal vector. 625:, with perfectly diffuse reflection. This is unrealistic for many types of materials, especially metals, glass and smooth plastics, and will lead to aberrations in the resulting normal vectors. 539: 608: 648:
Many techniques ultimately rely on modelling the reflectance function of the surface, that is, how much light is reflected in each direction. This reflectance function has to be
290: 358: 117: 223: 475: 684: 404: 444: 424: 381: 313: 246: 197: 177: 157: 137: 67:, and was analyzed by B. K. P. Horn in 1989. Photometric stereo has since been generalized to many other situations, including extended light sources and non- 780:
B. K. P. Horn, 1989. Obtaining shape from shading information. In B. K. P. Horn and M. J. Brooks, eds., Shape from Shading, pages 121–171. MIT Press.
662: 688: 71:
surface finishes. Current research aims to make the method work in the presence of projected shadows, highlights, and non-uniform lighting.
665:(BRDF) model, a surface may distribute the amount of light it receives in any outward direction. This is the most general known model for 228:
This model can easily be extended to surfaces with non-uniform albedo, while keeping the problem linear. Taking an albedo reflectivity of
41:
Photometric stereo analyzes multiple images of an object under different lighting conditions to estimate a normal direction at each pixel.
838: 890: 903: 63:
The technique was originally introduced by Woodham in 1980. The special case where the data is a single image is known as
17: 864: 640:, the commonly used model to render surfaces started with Lambertian surfaces and progressed first to include simple 679:
and the resulting light directions, these cones can be approximated and therefore the normal vectors of the surface.
851: 695:. However, such methods are still fairly restrictive in photometric stereo. Better results have been achieved with 790: 744: 447: 841:. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-3, issue 6, pages 661-669. IEEE. 793:. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, issue 10, pages 1239-1252. IEEE. 791:
The 4-source photometric stereo technique for 3-dimensional surfaces in the presence of highlights and shadows
483: 545: 446:
is not square (there are more than 3 lights), a generalisation of the inverse can be obtained using the
922: 692: 628:
Many methods have been developed to lift this assumption. In this section, a few of these are listed.
927: 254: 804: 321: 90: 622: 202: 80: 68: 31: 839:
Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method
825: 453: 893:. In 2011 IEEE Conference on Computer Vision and Pattern Recognition, pages 689-696. IEEE. 854:. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 8. IEEE. 828:. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 2. IEEE. 8: 932: 713: 641: 57: 877: 386: 906:. In IEEE Conference on Computer Vision and Pattern Recognition, 2007, pages 1-8. IEEE. 429: 409: 366: 298: 231: 182: 162: 142: 122: 683:
Some progress has been made towards modelling an even more general surfaces, such as
637: 315:
is square (there are exactly 3 lights) and non-singular, it can be inverted, giving:
696: 666: 649: 852:
Example-Based Photometric Stereo: Shape Reconstruction with General, Verying BRDFs
891:
Interreflection Removal for Photometric Stereo by Using Spectrum-dependent Albedo
708: 53: 49: 880:. In International Journal of Computer Vision, vol. 6, number 3, pages 173-195. 916: 826:
A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces
718: 769:
Photometric method for determining surface orientation from multiple images
613:
After which the normal vector and albedo can be solved as described above.
56:
of objects by observing that object under different lighting conditions (
863:
Michael Holroyd, Jason Lawrence, Greg Humphreys and Todd Zickler, 2008.
723: 904:
Polarization and Phase-shifting for 3D Scanning of Translucent Objects
37: 902:
Tongbo Chen, Hendrik Lensch, Christian Fuchs and H.P. Seidel, 2007.
689:
Bidirectional surface scattering reflectance distribution functions
621:
The classical photometric stereo problem concerns itself only with
84: 87:— the problem can be solved by inverting the linear equation 802: 867:. In ACM SIGGRAPH Asia 2008 Papers, pages 133:1-133:9. ACM. 865:
A Photometric Approach for Estimating Normals and Tangents
876:
Shree K. Nayar, Katsushi Ikeuchi and Takeo Kanade, 1991.
248:, the formula for the reflected light intensity becomes: 685:
Spatially Varying Bidirectional Distribution Functions
83:, known point-like distant light sources, and uniform 548: 486: 456: 432: 412: 389: 369: 324: 301: 257: 234: 205: 185: 165: 145: 125: 93: 824:Hemant D. Tagare and Rui J.P. de Figueiredo, 1991. 363:Since the normal vector is known to have length 1, 602: 533: 469: 438: 418: 398: 375: 352: 307: 284: 240: 217: 191: 171: 151: 131: 111: 914: 889:Miao Liao, Xinyu Huang and Ruigang Yang, 2011. 663:Bidirectional reflectance distribution function 426:is the normalised direction of that vector. If 783: 850:Aaron Hertzmann and Steven M. Seitz, 2005. 656: 761: 616: 745:"Radiometry, BRDF and Photometric Stereo" 774: 450:, by simply multiplying both sides with 36: 771:. Optical Engineerings 19, I, 139-144. 631: 534:{\displaystyle L^{T}I=L^{T}k(L\cdot n)} 225:matrix of normalized light directions. 79:Under Woodham's original assumptions — 14: 915: 603:{\displaystyle (L^{T}L)^{-1}L^{T}I=kn} 179:is the (unknown) surface normal, and 742: 24: 803:Chaman Singh Verma and Mon-Ju Wu. 789:S. Barsky and Maria Petrou, 2003. 25: 944: 807:. University of Wisconsin-Madison 383:must be the length of the vector 896: 883: 870: 74: 857: 844: 831: 818: 796: 736: 566: 549: 528: 516: 279: 267: 13: 1: 729: 691:(BSSRDF), and accounting for 285:{\displaystyle I=k(L\cdot n)} 7: 878:Shape from interreflections 702: 448:Moore–Penrose pseudoinverse 10: 949: 353:{\displaystyle L^{-1}I=kn} 112:{\displaystyle I=L\cdot n} 29: 750:. Northwestern University 218:{\displaystyle 3\times m} 837:Katsushi Ikeuchi, 1981. 657:General BRDFs and beyond 30:Not to be confused with 617:Non-Lambertian surfaces 139:is a (known) vector of 604: 535: 471: 440: 420: 400: 377: 354: 309: 286: 242: 219: 193: 173: 159:observed intensities, 153: 133: 113: 81:Lambertian reflectance 42: 605: 536: 472: 470:{\displaystyle L^{T}} 441: 421: 401: 378: 355: 310: 287: 243: 220: 194: 174: 154: 134: 114: 40: 32:Stereo photogrammetry 805:"Photometric Stereo" 767:Woodham, R.J. 1980. 642:specular reflections 632:Specular reflections 546: 484: 454: 430: 410: 387: 367: 322: 299: 255: 232: 203: 183: 163: 143: 123: 91: 27:3D imaging technique 623:Lambertian surfaces 52:for estimating the 600: 531: 467: 436: 416: 399:{\displaystyle kn} 396: 373: 350: 305: 282: 238: 215: 189: 169: 149: 129: 109: 65:shape from shading 48:is a technique in 46:Photometric stereo 43: 18:Shape from shading 923:Computer graphics 661:According to the 638:computer graphics 636:Historically, in 439:{\displaystyle L} 419:{\displaystyle n} 376:{\displaystyle k} 308:{\displaystyle L} 241:{\displaystyle k} 192:{\displaystyle L} 172:{\displaystyle n} 152:{\displaystyle m} 132:{\displaystyle I} 16:(Redirected from 940: 907: 900: 894: 887: 881: 874: 868: 861: 855: 848: 842: 835: 829: 822: 816: 815: 813: 812: 800: 794: 787: 781: 778: 772: 765: 759: 758: 756: 755: 749: 740: 697:structured light 693:interreflections 609: 607: 606: 601: 587: 586: 577: 576: 561: 560: 540: 538: 537: 532: 512: 511: 496: 495: 476: 474: 473: 468: 466: 465: 445: 443: 442: 437: 425: 423: 422: 417: 405: 403: 402: 397: 382: 380: 379: 374: 359: 357: 356: 351: 337: 336: 314: 312: 311: 306: 291: 289: 288: 283: 247: 245: 244: 239: 224: 222: 221: 216: 198: 196: 195: 190: 178: 176: 175: 170: 158: 156: 155: 150: 138: 136: 135: 130: 118: 116: 115: 110: 21: 948: 947: 943: 942: 941: 939: 938: 937: 928:Computer vision 913: 912: 911: 910: 901: 897: 888: 884: 875: 871: 862: 858: 849: 845: 836: 832: 823: 819: 810: 808: 801: 797: 788: 784: 779: 775: 766: 762: 753: 751: 747: 741: 737: 732: 709:Photoclinometry 705: 659: 634: 619: 582: 578: 569: 565: 556: 552: 547: 544: 543: 507: 503: 491: 487: 485: 482: 481: 461: 457: 455: 452: 451: 431: 428: 427: 411: 408: 407: 388: 385: 384: 368: 365: 364: 329: 325: 323: 320: 319: 300: 297: 296: 256: 253: 252: 233: 230: 229: 204: 201: 200: 184: 181: 180: 164: 161: 160: 144: 141: 140: 124: 121: 120: 92: 89: 88: 77: 54:surface normals 50:computer vision 35: 28: 23: 22: 15: 12: 11: 5: 946: 936: 935: 930: 925: 909: 908: 895: 882: 869: 856: 843: 830: 817: 795: 782: 773: 760: 734: 733: 731: 728: 727: 726: 721: 716: 711: 704: 701: 681: 680: 676: 658: 655: 654: 653: 633: 630: 618: 615: 611: 610: 599: 596: 593: 590: 585: 581: 575: 572: 568: 564: 559: 555: 551: 541: 530: 527: 524: 521: 518: 515: 510: 506: 502: 499: 494: 490: 464: 460: 435: 415: 395: 392: 372: 361: 360: 349: 346: 343: 340: 335: 332: 328: 304: 293: 292: 281: 278: 275: 272: 269: 266: 263: 260: 237: 214: 211: 208: 188: 168: 148: 128: 108: 105: 102: 99: 96: 76: 73: 26: 9: 6: 4: 3: 2: 945: 934: 931: 929: 926: 924: 921: 920: 918: 905: 899: 892: 886: 879: 873: 866: 860: 853: 847: 840: 834: 827: 821: 806: 799: 792: 786: 777: 770: 764: 746: 739: 735: 725: 722: 720: 719:Stereo vision 717: 715: 712: 710: 707: 706: 700: 698: 694: 690: 686: 677: 673: 672: 671: 668: 664: 651: 647: 646: 645: 643: 639: 629: 626: 624: 614: 597: 594: 591: 588: 583: 579: 573: 570: 562: 557: 553: 542: 525: 522: 519: 513: 508: 504: 500: 497: 492: 488: 480: 479: 478: 462: 458: 449: 433: 413: 393: 390: 370: 347: 344: 341: 338: 333: 330: 326: 318: 317: 316: 302: 276: 273: 270: 264: 261: 258: 251: 250: 249: 235: 226: 212: 209: 206: 199:is a (known) 186: 166: 146: 126: 106: 103: 100: 97: 94: 86: 82: 72: 70: 66: 61: 59: 55: 51: 47: 39: 33: 19: 898: 885: 872: 859: 846: 833: 820: 809:. Retrieved 798: 785: 776: 763: 752:. Retrieved 738: 682: 660: 635: 627: 620: 612: 362: 294: 227: 78: 75:Basic Method 64: 62: 45: 44: 933:3D imaging 917:Categories 811:2015-03-24 754:2015-03-25 730:References 724:3D scanner 714:Photometry 687:(SVBRDF), 650:invertible 69:Lambertian 58:photometry 743:Ying Wu. 571:− 523:⋅ 331:− 274:⋅ 210:× 104:⋅ 703:See also 477:giving: 119:, where 667:opaque 406:, and 85:albedo 748:(PDF) 295:If 919:: 699:. 814:. 757:. 598:n 595:k 592:= 589:I 584:T 580:L 574:1 567:) 563:L 558:T 554:L 550:( 529:) 526:n 520:L 517:( 514:k 509:T 505:L 501:= 498:I 493:T 489:L 463:T 459:L 434:L 414:n 394:n 391:k 371:k 348:n 345:k 342:= 339:I 334:1 327:L 303:L 280:) 277:n 271:L 268:( 265:k 262:= 259:I 236:k 213:m 207:3 187:L 167:n 147:m 127:I 107:n 101:L 98:= 95:I 34:. 20:)

Index

Shape from shading
Stereo photogrammetry

computer vision
surface normals
photometry
Lambertian
Lambertian reflectance
albedo
Moore–Penrose pseudoinverse
Lambertian surfaces
computer graphics
specular reflections
invertible
Bidirectional reflectance distribution function
opaque
Spatially Varying Bidirectional Distribution Functions
Bidirectional surface scattering reflectance distribution functions
interreflections
structured light
Photoclinometry
Photometry
Stereo vision
3D scanner
"Radiometry, BRDF and Photometric Stereo"
Photometric method for determining surface orientation from multiple images
The 4-source photometric stereo technique for 3-dimensional surfaces in the presence of highlights and shadows
"Photometric Stereo"
A Theory of Photometric Stereo for a Class of Diffuse Non-Lambertian Surfaces
Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑