Imaging Description Production by Means of Deeper Neural Networks

Velichala Sucharitha, Kancharla Sneha, Dhandu Sravani, Sravani Jhade, Pochaboina Sravani, Sarangapur Sreeja
{"title":"Imaging Description Production by Means of Deeper Neural Networks","authors":"Velichala Sucharitha, Kancharla Sneha, Dhandu Sravani, Sravani Jhade, Pochaboina Sravani, Sarangapur Sreeja","doi":"10.1109/ACCAI58221.2023.10200618","DOIUrl":null,"url":null,"abstract":"Natural language processing (NLP) and computer vision (CV) methods may be used to provide a textual interpretation and explanation of an image's meaning. The human brain can provide a detailed description of a picture, but can a computer do the same? Captioning images is considered difficult work in the realm of artificial intelligence. Contextualizing an image and converting it into grammatically correct text requires the use of both natural language processing and computer vision methods. Improved deep learning techniques and a wealth of publicly available datasets have made it possible to construct a variety of models for automatically generating picture descriptions. Picture classification based on the greatest number of items in the image is the first step in creating an acceptable description of an image provided as input. We can do this with the help of a neural network and certain NLP principles. In this study, we explain in depth how a \"Convolutional Neural Network\" and Long Short-Term Memory were used to build a visual description.Both pictures and texts may be classified with the help of \"Convolutional Neural Networks\" (or \"CNNs\") and \"Recurrent Neural Networks\" (or \"RNNs\") (RNNs). We trained the model to draw from a bigger lexical set when describing the images it has seen in order to increase the precision of its predictions. We conducted a number of trials across many picture datasets, and found that visual description is the single most important factor in determining a model's accuracy. In general, the outcome improves as the amount of the dataset grows.","PeriodicalId":382104,"journal":{"name":"2023 International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ACCAI58221.2023.10200618","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Natural language processing (NLP) and computer vision (CV) methods may be used to provide a textual interpretation and explanation of an image's meaning. The human brain can provide a detailed description of a picture, but can a computer do the same? Captioning images is considered difficult work in the realm of artificial intelligence. Contextualizing an image and converting it into grammatically correct text requires the use of both natural language processing and computer vision methods. Improved deep learning techniques and a wealth of publicly available datasets have made it possible to construct a variety of models for automatically generating picture descriptions. Picture classification based on the greatest number of items in the image is the first step in creating an acceptable description of an image provided as input. We can do this with the help of a neural network and certain NLP principles. In this study, we explain in depth how a "Convolutional Neural Network" and Long Short-Term Memory were used to build a visual description.Both pictures and texts may be classified with the help of "Convolutional Neural Networks" (or "CNNs") and "Recurrent Neural Networks" (or "RNNs") (RNNs). We trained the model to draw from a bigger lexical set when describing the images it has seen in order to increase the precision of its predictions. We conducted a number of trials across many picture datasets, and found that visual description is the single most important factor in determining a model's accuracy. In general, the outcome improves as the amount of the dataset grows.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于深层神经网络的图像描述生成
自然语言处理(NLP)和计算机视觉(CV)方法可用于提供图像含义的文本解释和解释。人脑可以对图片进行详细描述,但计算机能做到吗?在人工智能领域,给图片加上字幕被认为是一项困难的工作。语境化图像并将其转换为语法正确的文本需要使用自然语言处理和计算机视觉方法。改进的深度学习技术和大量公开可用的数据集使得构建各种模型来自动生成图像描述成为可能。基于图像中最大项目数的图像分类是创建作为输入提供的图像的可接受描述的第一步。我们可以在神经网络和某些NLP原理的帮助下做到这一点。在这项研究中,我们深入解释了如何使用“卷积神经网络”和长短期记忆来构建视觉描述。图片和文本都可以在“卷积神经网络”(或“cnn”)和“循环神经网络”(或“RNNs”)(RNNs)的帮助下进行分类。我们训练模型在描述它所看到的图像时从更大的词汇集中提取,以提高其预测的精度。我们对许多图片数据集进行了大量的试验,发现视觉描述是决定模型准确性的最重要因素。一般来说,结果会随着数据集的增长而改善。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
An Innovative Method for Encrypting Pictures without a Key Forecasting Consumer Price Index (CPI) Using Deep Learning and Hybrid Ensemble Technique Enhancing the Robustness of Deep Neural Networks using Deep Neural Rejection An Image-Processing-Based System for Object Detection Imaging Description Production by Means of Deeper Neural Networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1