Using Artificial Neural Networks for Solving Forensic Handwriting Examination Problems: Foreign Experience Analysis
https://doi.org/10.30764/1819-2785-2025-1-44-65
Abstract
This paper studies the foreign experience of artificial neural networks (ANN) application in forensic handwriting examination. Given the active ANN implementation in various areas of public life, greater attention is paid to the integration of this technology into forensic activities. According to the opinion of a number of scientists and lawyers the issue of applying neural networks to forensic handwriting examination is particularly acute as they can significantly improve the objectivity of handwriting examinations.
The article gives a brief overview of history and current developments in computer technology use for handwriting examination as well as the connection and mutual influence of forensics and biometrics in this field which is particularly characteristic of foreign practice of forensic handwriting examination. Furthermore, the author presents examples of successful projects and experiments demonstrating effective use of neural networks to identify and verify an individual by his handwriting. The paper also discusses the prospects of this field and identifies the key challenges hindering, in the author’s opinion, the ANN integration in forensic handwriting examination.
About the Author
V. A. Mishchuk
Peoples’ Friendship University of Russia named after Patrice Lumumba
Russian Federation
Russian Federation
Mishchuk Vsevolod Aleksandrovich – PhD student of the Department of Forensic Science, Institute of Law
Moscow 117198
References
1. Hicklin R.A., Eisenhart L., Richetelli N., Miller M.D., Belcastro P. et al. Accuracy and Reliability of Forensic Handwriting Comparisons. Proceedings of the National Academy of Sciences. 2022. Vol. 119. No. 32. https://doi.org/10.1073/pnas.2119944119
2. Оkhlupina A.N. The Problem of Unambiguous Identification of Signatures and Its Impact on the Automation of Expert Research. Altai Legal Bulletin. 2019. No. 1 (25). P. 115–120. (In Russ.).
3. Scientific Working Group for Forensic Document Examination (SWGDOC). https://swgdoc.org
4. Taylor M., Bishop B., Burkes T., Caligiuri M., Found B. et al. Forensic Handwriting Examination and Human Factors: Improving the Practice Through a Systems Approach. NIST Interagency/Internal Report (NISTIR). 2021. https://doi.org/10.6028/NIST.IR.8282r1
5. Best Practice Manual for the Forensic Handwriting Examination. 4th ed. ENFSI. 2022. https://enfsi.eu/wp-content/uploads/2023/02/BPM-Handwriting-Ed.-4.pdf
6. ISO/IEC TR 24741:2018. Information technology – Biometrics – Overview and application, MOD. https://files.stroyinf.ru/Data2/1/4293725/4293725565.pdf?ysclid=m82sulc6uq418677385
7. Koshmanov M.P., Koshmanov P.M. Stages and Basic Directions of Computer Technologies Implementation in Forensic Handwriting Examination. Forensic Scientist. 2008. No. 3. P. 35–40. (In Russ.).
8. Minaev Yu., Mamaev V. Results and Prospects of Biometric Technology Development. Security and Safety. 01.02.2021. https://www.secuteck.ru/articles/itogi-i-perspektivyrazvitiya-biometricheskih-tekhnologij
9. Ferguson R.W. Presentation to a Workshop on Promoting the Use of Electronic Payments, Held at the Federal Reserve Bank of Chicago. Chicago, 2000.
10. Potter E.J. Customer Authentication: The Evolution of Signature Verification in Financial Institutions. Journal of Economic Crime Management. 2002. Vol. 1. No. 1. P. 1–19.
11. Dormehl L. Tracing the History and Evolution of the Stylus. Digital Trends. 04.05.2021. https://www.digitaltrends.com/mobile/evolutionhistory-of-the-stylus/#dt-heading-as-we-may-think
12. Yoshimura M., Kimura F., Yoshimura I. Experimental Comparison of Two Types of Methods of Writer Identification. IEICE Transactions (1976– 1990). 1982. Vol. 65. No. 6. P. 345–352.
13. Nagel R.N., Rosenfeld A. Computer Detection of Freehand Forgeries. IEEE Transactions on Computers. 1977. Vol. C-26. No. 9. P. 895–905. https://doi.org/10.1109/tc.1977.1674937
14. Plamondon R., Lorette G. Automatic Signature Verification and Writer Identification – the State of the Art. Pattern Recognition. 1989. Vol. 22. No. 2. P. 107–131. https://doi.org/10.1016/0031-3203(89)90059-9
15. Leclerc F., Plamondon R. Automatic Signature Verification: The State of the Art – 1989–1993. International Journal of Pattern Recognition and Artificial Intelligence. 1994. Vol. 8. No. 3. P. 643–660. https://doi.org/10.1142/S0218001494000346
16. Srihari S., Leedham G. Survey of Computer Methods in Forensic Handwritten Document Examination. Proceedings Eleventh International Graphonomics Society Conference. Sccottsdale, 2003. P. 278–281.
17. Sreeraj M., Idicula S.M. A Survey on Writer Identification Schemes. International Journal of Computer Applications. 2011. Vol. 26. No. 2. P. 23–33. https://doi.org/10.5120/3075-4205
18. Harralson H.H., Miller L.S. Huber and Headrick’s Handwriting Identification: Facts and Fundamentals. 2nd ed. CRC Press, 2017. 442 p. https://doi.org/10.4324/9781315152462
19. Deviterne-LapeyreM., IbrahimS. Interpol Questioned Documents Review 2019–2022. Forensic Science International: Synergy. 2023. Vol. 6. https://doi.org/10.1016/j.fsisyn.2022.100300
20. Ivanov A.I. Biometric Personality Identification Based on Subconscious Movement Dynamics. Penza: Publishing House of Penza State University, 2000. 187 p. (In Russ.).
21. Risinger D.M., Denbeaux M.P., Saks M.J. Exorcism of Ignorance as a Proxy for Rational Knowledge: The Lessons of Handwriting Identification “Expertise”. The University of Pennsylvania Law Review. 1989. Vol. 137. No. 3. P. 731–792. https://doi.org/10.2307/3312276
22. Crawford M.A. Daubert Standard. Walden University, 2014. 8 p. https://doi.org/10.13140/2.1.2002.2560
23. United States v. Starzecpyzel, 880 F. Supp. 1027. (S.D.N.Y. 1995) // Justia. U.S. Law. https://law.justia.com/cases/federal/districtcourts/FSupp/880/1027/1408539
24. Strengthening Forensic Science in the United States: a Path Forward. The National Academies Press, 2009. 328 p.
25. Robert E. Pettus, Appellant, v. United States, Appellee // FindLaw. https://caselaw.findlaw.com/court/dc-court-of-appeals/1593870.html
26. Koehler J.J. Intuitive Error Rate Estimates for the Forensic Sciences. Jurimetrics. 2017. Vol. 57. P. 153–168. http://doi.org/10.2139/ssrn.2817443
27. Report to the President: Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods. CreateSpace Independent Publishing Platform, 2016. 132 p.
28. Li B., Li N. Handwriting Expertise Reliability: a Review. Journal of Forensic Science and Medicine. 2019. Vol. 5. No. 4. P. 181–186. https://doi.org/10.4103/jfsm.jfsm_44_19
29. Kang T.-Y., Kim H., Yook S., Lee J. A Study on Factors that Affect Error Rates in Handwriting Examinations of Korean Characters by Forensic Document Examiners and Non-Experts. Forensic Science International. 2022. Vol. 334. https://doi.org/10.1016/j.forsciint.2022.111266
30. Crot S., Marquis R. A comparative Review of Error Rates in Forensic Handwriting Examination. Journal of Forensic Sciences. 2024. Vol. 69. No. 6. P. 2127–2138. https://doi.org/10.1111/1556-4029.15589
31. Huber R.A. Handwriting Identification: Facts and Fundamentals. CRC Press, 1999. 456 p.
32. Fairhurst M.C. Signature Verification Revisited: Promoting Practical Exploitation of Biometric Technology. Electronics & Communication Engineering Journal. 1997. Vol. 9. No. 6. P. 273– 280.
33. Kaur R., Rani R., Pahuja R. Text-Dependent and Text-Independent Writer Identification Approaches: Challenges and Future Directions. International Journal of Software Innovation. 2022. Vol. 10. No. 1. P. 1–23.
34. Mitchell T.M. Machine Learning. McGraw-Hill, 1997. 414 p.
35. Zhang X.-Y., Xie G.S., Liu Ch.-L., Bengio Y. EndTo-End Online Writer Identification with Recurrent Neural Network. IEEE Transactions on Human-Machine Systems. 2016. Vol. 47. No. 2. P. 285–292. https://doi.org/10.1109/THMS.2016.2634921
36. Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L. et al. Attention is All You Need. Advances in Neural Information Processing Systems. 2017. Vol. 30.
37. Tolosana R., Vera-Rodriguez R., Fierrez J., Ortega-Garcia J. Biometric Signature Verification Using Recurrent Neural Networks. 14th IAPR International Conference on Document Analysis and Recognition (ICDAR). IEEE, 2017. P. 652–657. https://doi.org/10.1109/icdar.2017.112
38. Dhieb T., Njah S., Boubaker H., Ouarda W., Ayed M.B. et al. Towards a Novel Biometric System for Forensic Document Examination. Computers & Security. 2020. Vol. 97. https://doi.org/10.1016/j.cose.2020.101973
39. Yang W., Jin L., Liu M. DeepWriterID: An Endto-End Online Text-Independent Writer Identification System. IEEE Intelligent Systems. 2016. Vol. 31. No. 2. P. 45–53. https://doi.org/10.1109/MIS.2016.22
40. Chen Z., Yu H.-X., Wu A., Zheng W.-Sh. LetterLevel Online Writer Identification // International Journal of Computer Vision. 2021. Vol. 129. P. 1394–1409. https://doi.org/10.1007/s11263-020-01414-y
41. Hameed M.M., Ahmad R., Kiah M.L.M., Murtaza G. Machine Learning-Based Offline Signature Verification Systems: A Systematic Review // Signal Processing: Image Communication. 2021. Vol. 93. https://doi.org/10.1016/j.image.2021.116139
42. Khosroshahi S.N.M., Razavi S.N., Sangar A.B., Majidzadeh K. Deep Neural Networks-Based Offline Writer Identification Using Heterogeneous Handwriting Data: an Evaluation via a Novel Standard Dataset. Journal of Ambient Intelligence and Humanized Computing. 2022. Vol. 13. P. 2685–2704. https://doi.org/10.1007/s12652-021-03253-2
43. Nguyen H.T., Nguyen C.T., Ino T., Indurkhya B., Nakagawa M. Text-Independent Writer Identification Using Convolutional Neural Network. Pattern Recognition Letters. 2019. Vol. 121. P. 104–112. https://doi.org/10.1016/j.patrec.2018.07.022
44. Chahi A., El merabet Y., Ruichek Y., Touahni R. WriterINet: a Multi-Path Deep CNN for Offline Text-Independent Writer Identification. International Journal on Document Analysis and Recognition (IJDAR). 2023. Vol. 26. P. 89–107. https://doi.org/10.1007/s10032-022-00418-3
45. Kumar P., Sharma A. Segmentation-free Writer Identification Based on Convolutional Neural Network. Computers & Electrical Engineering. 2020. Vol. 85. https://doi.org/10.1016/j.compeleceng.2020.106707
46. He Sh., Schomaker L. GR-RNN: Global-context Residual Recurrent Neural Networks for Writer Identification. Pattern Recognition. 2021. Vol. 117. https://doi.org/10.1016/j.patcog.2021.107975
47. Dey S., Dutta A., Toledo J.I., Ghosh S.K., Llados J. et al. SigNet: Convolutional Siamese Network for Writer Independent Offline Signature Verification. Pattern Recognition Letters. 2017. https://doi.org/10.48550/arXiv.1707.02131
48. Kumar V., Sundaram S. Siamese Based Neural Network for Offline Writer Identification on Word Level Data. arXiv. 2022. https://doi.org/10.48550/arXiv.2211.14443
49. Wang S., Jia S. Signature Handwriting Identification Based on Generative Adversarial Networks. Journal of Physics: Conference Series. 2019. Vol. 1187. No. 4. P. 42–47. https://doi.org/10.1088/1742-6596/1187/4/042047
50. Kao H.-H., Wen Ch.-Y. An Offline Signature Verification and Forgery Detection Method Based on a Single Known Sample and an Explainable Deep Learning Approach. Applied Sciences. 2020. Vol. 10. No. 11. https://doi.org/10.3390/app10113716
51. Simonyan K., Vedaldi A., Zisserman A. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. arXiv. 2014. https://doi.org/10.48550/arXiv.1312.6034
52. Marcinowski M. Top Interpretable Neural Network for Handwriting Identification. Journal of Forensic Sciences. 2022. Vol. 67. No. 3. P. 1140–1148. https://doi.org/10.1111/1556-4029.14978
53. Rossinskaya E.R., Bodrov N.F. The Current State and Prospects for the Study of Digital Trace Images in Forensic Handwriting Expertise. Forensics: Yesterday, Today, Tomorrow. 2022. Vol. 21. No. 1. P. 121–135 (In Russ.). https://doi.org/10.55001/2587-9820.2022.44.98.011
54. Zhuravel A.A., Troshko N.V., Edzhubov L.G. Using Generalized Portrait Algorithm for Pattern Recognition in Forensic Handwriting Examination. Legal Cybernetics. 1970. P. 212–227. (In Russ.).
55. Garrett B.L., Rudin C. Interpretable Algorithmic Forensics. Proceedings of the National Academy of Sciences. 2023. Vol. 120. No. 41. https://doi.org/10.1073/pnas.2301842120
56. Khaziev Sh.N., Shtokhov A.N. Forensic Examination in Cases of Mistaken Biometric Identification. Theory and Practice of Forensic Science. 2024. Vol. 19. No. 3. P. 88–102. (In Russ.). https://doi.org/10.30764/1819-2785-2024-3-88-102
57. Khaziev Sh.N. Forensic Basics of Modern Biometric Technologies. Theory and Practice of Forensic Science. 2023. Vol. 18. No 1. P. 16– 21. (In Russ.). https://doi.org/10.30764/1819-2785-2023-1-16-21
Review
For citations:
Mishchuk V.A. Using Artificial Neural Networks for Solving Forensic Handwriting Examination Problems: Foreign Experience Analysis. Theory and Practice of Forensic Science. 2025;20(1):44-65. (In Russ.) https://doi.org/10.30764/1819-2785-2025-1-44-65
Views:
286
Email this article 