ISSN 2071-8594

Russian academy of sciences


Gennady Osipov

V.V. Arlazarov, A.E. Zhukovsky, V.E. Krivtsov, V.V. Postnikov Usage of the intersection graph for camera-based document capture


Document capture with a smartphone camera is already here to stay. Interactive applications for document capture and its enhancement have filled mobile application stores. However, discounting the predictions and judging only from the experience of using such applications, they are not yet ready to compete with stationary scanners when high quality and reliability is required. This paper is devoted to analysis of the problem of document detection in the image and evaluation of the quality of existing mobile applications. Based on this analysis we present a new reliable algorithm for document capture, based on the boundary segments detection and constructing an intersections graph to fit rectangular projective model. The algorithm achieves about 95% quality of document detection and outperforms all of the reviewed algorithms, implemented in mobile applications.


document detection; segments detection; projective transform; mobile cameras.


1. Arlazarov V.V., Zhukovskiy A.Ye., Krivtsov V.Ye., Nikolaev D.P.,. Polevoy D.V. Analiz osobennostey ispolzovaniya statsionarnykh i mobilnykh malorazmernykh tsifrovykh video kamer dlya raspoznavaniya dokumentov, Informatsionnye tekhnologii i vychislitelnye sistemy, tom 3, 2014.S. 71-81.
2. Liang J., Doermann D., Li H. Camera-based analysis of text and documents: a survey, Int. J. of Document Analysis and Recognition, Vol. 7, Issue 2, 2005. p. 84-104.
3. Doermann D., Liang J., Li H. Progress in Camera-Based Document Image Analysis, IEEE P roc. 7th Int. Conf. on Document Analysis and Recognition, Vol.1, 2003. p.606-616.
4. Burie JC., Chazalon J., Coustaty M., Eskenazi S., Luqman M.M., Mehri M., Nayef N., Ogier JM., Prum S., Rusinol M. ICDAR2015 Competition on Smartphone Document Capture and OCR (SmartDoc), 13th Int. Conf. on Document Analysis and Recognition. 2015.
5. Chen F., Carter S., Denoue L., Kumar J. SmartDCap: Semi-Automatic Capture of Higher Quality Document Images from a Smartphone, ACM Proc. of the 2013 Int. Conf. on Intelligent User Interfaces, 2013. r.287-296.
6. Takeda K., Kise K., Iwamura M. Real-Time Document Image Retrieval on a Smartphone, IEEE Proc. 10th Int. Workshop on Document Analysis Systems, 2012. p. 225-229.
7. Nakai T., Kise K., Iwamura M. Camera-Based Document Image Retrieval as Voting for Partial Signatures of Projective Invariants, IEEE Proc. 8th Int. Conf. on Document Analysis and Recognition, Vol. 1, 2005. p.379-383.
8. Skoryukina N., Nikolaev D., Sheshkus A., Polevoy D. Real Time Rectangular Document Detection on Mobile Devices, SPIE Proc. 9445, 7th Int. Conf. on Machine Vision 2014.
9. Shiryaev A. N. Veroyatnost, 3-e izd., M.: MTsNMO. 2004.
10. Duda H. Use of the hough transformation to detect lines and curves in pictures, Mag. Comm. ACM 15.1972.
11. Nikolaev D., Karpenko S., Nikolaev I., Nikolayev P. Hough transform: underestimated tool in the computer vision field, Proc. of the 22th European Conf. on Modelling and Simulation, vol. 238.2008.
12. Ershov E., Terekhin A., Nikolaev D., Postnikov V., Karpenko S. Fast Hough transform analysis: pattern deviation from line segment, 8th Int. Conf. on Machine Vision. 2015.
13. Hartley R., Zisserman A. Multiple view geometry in computer vision, Cambridge University Press, New York.2003.
14. Shakhno K.U. Sbornik zadach po elementarnoy matematike povyshennoy trudnosti, M.: Ripol Klassik.2013.
15. Prasolov V. V. Zadachi po planimetrii,4-e izd., M.: MTsNMO.2001.
16. Audet C., Dennis J. E. Mesh Adaptive Direct Search Algorithms for Constrained Optimization, SIAM J. Optim. 17, 2006. p.188–217.
17. Digabel S. Le. Algorithm 909: NOMAD: Nonlinear optimization with the MADS algorithm, ACM Trans. Math. Softw. 37, 4.2011.
18. Kalman R. E. A New Approach to Linear Filtering and Prediction Problems, J. of Basic Engineering 82, 35.1960.
19. Karpenko S., Konovalenko I., Miller A., Miller B., Nikolaev D. UAV Control on the Basis of 3D Landmark Bearing-Only Observations, Sensors, vol. 15, 12.2015.