We sample bidirectional reflection distribution functions (BRDFs) of materials and construct scenes with objects made of those materials

Accurate models of real-world 3D scenes complete with geometry, surface textures, and surface radiance models, finds application within multiple fields such as design, additive manufacturing, and virtual reality, amongst others. As an example, having an accurate 3D model of a real-world scene such as the internal structure of a wind turbine nacelle can be used to offer customers, managers, and trainees the opportunity to walk freely around inside this complicated structure and learn about its design without getting their hands dirty, by using virtual reality. This project is about creating a dataset of scene geometry and surface reflectance models which will create opportunities for doing research into realistic models of 3D scenes and their applications.

The radiometric behaviour of an object plays a crucial role in MVS. Often this behaviour has been ignored or at most assumed Lambertian. This allows for acceptable reconstructions of geometry, but often poor recovery of the reflectance. For more accurate MVS and reflectance capture, the BRDF of an object should be taken into account and this is a problem that receives a growing amount of attention.
Within the field of photometric stereo, the reflectance of an object is the key element in recovering surface normals and thereby indirectly the object's geometry. Also here, assumptions about reflectance are made, these include e.g. Lambertian behaviour or isotropic BRDFs.

For both of the above areas, a multi-view data set having ground-truth reflectance behaviour is of great value. We are therefore currently working on a MVS dataset where not only the ground-truth geometry is given, but also a densely sampled BRDF ground-truth for all materials in the scene.

Multi-View BRDF

About the project

We are densely sampling the BRDFs of a collection of objects whose surfaces consist of one or a few, isotropic, BRDFs. The BRDFs of each material will be stored in the 3-dimensional Rusinkiewicz frame for isotropic BRDFs, as also done in the MERL database, although with a coarser resolution of 7.5 degrees in each dimension. In conjunction with the densely sampled BRDFs, stereo images of scenes containing the sampled objects are acquired for a wide range of directions. Objects are of relatively low geometric complexity, and scenes consists of one or more of the objects.

Publications

A Variational Study on BRDF Reconstruction in a Structured Light Scanner [2017]

J. B. Nielsen, J. D. Stets, R. A. Lyngby, H. Aanæs, A. B. Dahl, J. R. Frisvad
Proceedings of International Conference on Computer Vision Workshop (ICCVW 2017) , IEEE, 143-152

Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic rendering [2017]

J. D. Stets, A. Dal_Corso, J. B. Nielsen, R. A. Lyngby, S. H. N. Jensen, J. Wilm, M. B. Doest, C. Gundlach, E. R. Eiriksson, K. Conradsen, A. B. Dahl, J. A. Bærentzen, J. R. Frisvad, H. Aanæs
Applied Optics , 56, 7679-7690

Robot Based BRDF Measurement System [2017]

M. E. B. Doest
Department of Applied Mathematics and Computer Science, Technical University of Denmark

On Practical Sampling of Bidirectional Reflectance [2016]

J. B. Nielsen
Department of Applied Mathematics and Computer Science, Technical University of Denmark

On Optimal, Minimal BRDF Sampling for Reflectance Acquisition [2015]

J. B. Nielsen, H. W. Jensen, R. Ramamoorthi
ACM Transactions on Graphics (TOG) , 34, 186:1-186:11

Our 3D Vision Data-Sets in the Making [2015]

H. Aanæs, K. Conradsen, A. Dal_Corso, A. B. Dahl, A. D. Bue, M. Doest, J. R. Frisvad, S. H. N. Jensen, J. B. Nielsen, J. D. Stets, G. Vogiatzis
Conference on Computer Vision and Pattern Recognition 2015 , Institute of Electrical and Electronics Engineers

Accuracy in Robot Generated Image Data Sets [2015]

H. Aanæs, A. B. Dahl
Image Analysis (Proceedings of SCIA 2015) , Springer, Lecture Notes in Computer Science, vol. 9127, 472-479

Quality Assurance Based on Descriptive and Parsimonious Appearance Models [2015]

J. B. Nielsen, E. R. Eiriksson, R. L. Kristensen, J. Wilm, J. R. Frisvad, K. Conradsen, H. Aanæs
Workshop on Material Appearance Modeling , The Eurographics Association

Contact

Mads Emil Brix Doest
[Ph.D. Student]
Technical University of Denmark
Rasmus Ahrenkiel Lyngby
[Ph.D. Student]
Technical University of Denmark
Jeppe Revall Frisvad
[Associate Professor]
Technical University of Denmark