Officer's Blog

Posted on Oct 29, 2023Read on Mirror.xyz

OSINT Lesson №3: AI, ChatGPT & Choosing a Pathway to Follow

Information has enormous power in the modern digital age, and access to it is now essential in many different fields. Investigative techniques could be completely changed by integrating ChatGPT and AI with OSINT activities as AI technologies advance.

Photo by ZHENYU LUO on Unsplash

This article will rely on information from my old articles so read them if you haven’t already:

https://officercia.mirror.xyz/Kfy7hVyHhwyBjei0pvPtoXroEJ3I3efE2c4XbvKm8aU

https://officercia.mirror.xyz/vqfkhx-hVQ2rI4rHx_Owsk_qBb5Zq9khuh5oLDSUR30

We will examine the meaning and importance of OSINT in today’s post. I’ll also go over how it includes compiling data from a range of public sources, including news articles, social media, online forums, and more, and how this information can be utilized to find undiscovered connections, monitor internet trends, and support decision-making!

First and foremost, I want to sincerely thank the authors of all the resource materials for their assistance, as they have been invaluable in providing me with much-needed information and removing the veil of secrecy! I also strongly advise that you read the list of resources and research for self-study that you will find separately in order to improve your comprehension.

I understand and respect your limited time, so I created a specific article with nothing superfluous for an easier access:

https://telegra.ph/OSINT--AI-10-28?source=post_page-----6f582eb420a0--------------------------------

Therefore, below you will see not a typical article, but a Systematization of Knowledge — SoK, in which I will rely on Authors that I myself trust in this matter. Let’s get started!


OSINT + AI = ?

Open Source Intelligence (OSINT) is currently the application of Artificial Intelligence (AI) in the work of professionals. It is a field that is experiencing significant progress and evolution thanks to the technological advances and opportunities provided by artificial intelligence. Along the way, we can see the ambiguity and quandary that accompanies the application of AI in OSINT, but we can also see the gusto and passion that encapsulates the field.

One of the main advantages of using AI for OSINT professionals, in my opinion, is its capacity to analyze vast amounts of data fast and accurately. This makes it possible to monitor social media, forums, news portals, and other data sources efficiently. This wide scope makes it possible to gather important data that aids in situation understanding and decision-making.

I will refer you to this great study, in our opinion, it is the best current illustrations of the mechanics of ChatGPT:

https://www.engraved.blog/building-a-virtual-machine-inside/?source=post_page-----6f582eb420a0--------------------------------

Artificial intelligence and its technologies are not always applied positively, though. There are certain restrictions and uncertainties with these solutions that must be taken into account. The availability of data and the inaccuracy of semantic and contextual interpretation may be factors limiting AI’s potential. Furthermore, there are moral concerns with the application of artificial intelligence to data collection and analysis.

There is no doubt that modern intelligence and information analysis depend on the use of artificial intelligence in the work of OSINT specialists. This is where obfuscation and ambiguity have a place. However, choppiness and passion also contribute significantly to improving the efficacy and efficiency of this kind of application.

arxiv.org/pdf/1910.14417.pdf

A significant contributing factor to the unpredictability and difficulty of artificial intelligence applications is the volume of data and information that must be handled. Deeper analysis is made possible by artificial intelligence (AI) systems, whose algorithms are able to identify patterns and trends that traditional methods might overlook. This opens up possibilities for more precise forecasts and consequential choices.

https://blog.sociallinks.io/using-the-power-of-chatgpt-for-osint/?source=post_page-----6f582eb420a0--------------------------------

Nevertheless, it should be noted that this field is still in the process of development and improvement. Through continuous research and innovation, we see promising opportunities for applying artificial intelligence to the work of OSINT practitioners. More and more people are beginning to realize the importance and value that AI can add to processes such as information gathering and analysis.

The role of artificial intelligence in the work of OSINT specialists cannot be underestimated. Despite some challenges and limitations, the application of AI has the potential to revolutionize the field by providing more accurate and efficient data analysis. The future of this field depends on our ability to adapt, innovate, and embrace the challenges that new AI capabilities present to us.

The application of artificial intelligence (AI) is becoming more widespread and significant in the work of open source intelligence (OSINT) professionals. This new technological advancement presents us with tremendous opportunities, while presenting us with some of the ambiguities and challenges that come with implementing AI in the OSINT field.

I’ll send you to this excellent study, which provides, in our opinion, the most up-to-date explanation of ChatGPT’s workings:

https://www.reddit.com/r/OSINT/comments/10tq6iz/how_to_use_chatgpt_for_osint/?utm_content=title&utm_medium=post_embed&utm_name=684e680f218443149cecc146a9af0399&utm_source=embedly&utm_term=10tq6iz

In summary, AI enables us to work with multiple information sources to solve complex problems. Artificial intelligence (AI) enables us to gather and use vast amounts of data effectively by automating information analysis through the use of big data processing and algorithms.

But occasionally, these technologies may give us anxiety and create some doubt about how to comprehend and interpret the data that is being gathered.

x.com/brianroemmele/status/1718378983874765167

The AI capabilities of OSINT allow experts to effectively analyze data and identify hidden relationships that would be difficult to achieve with manual analysis methods.

However, the static and homogeneous working style of artificial intelligence can be different from human behavior and performance. For example, we often use emotionally colored words and create some explosiveness in our statements.

However, AI doesn’t always have these qualities, and as a result, content can be more focused and lacking emotionality:

https://blog.gopenai.com/chatgpt-the-ai-powered-secret-weapon-for-osint-133a68d8302e?source=post_page-----6f582eb420a0--------------------------------

Despite these complexities, the application of AI to OSINT represents an important step forward. AI provides the ability to automate processes that previously required large amounts of human resources and time. It allows us to analyze information more efficiently and accurately and make informed decisions based on the data.

  • Role of AI: AI technologies, such as ChatGPT, provide OSINT specialists with advanced capabilities to process vast amounts of data, extract meaningful insights, and aid decision-making.

  • Enhanced Data Collection: ChatGPT can automate data collection, scouring online platforms, forums, and chatrooms, to efficiently gather relevant information, monitor trends, and identify potential threats in real-time.

  • Advanced Analysis: AI-powered tools help in rapid information categorization, sentiment analysis, and topic modeling, enabling OSINT specialists to identify patterns, uncover connections, and gain comprehensive situational awareness.

  • Natural Language Processing: AI algorithms can analyze and understand unstructured data, including multilingual sources, enabling OSINT specialists to overcome language barriers and access global information channels.

  • Automation and Efficiency: With AI assistance, manual tasks like data parsing, entity extraction, and link analysis can be automated, freeing up time for specialists to focus on higher-level analysis and decision-making.

In conclusion, the application of artificial intelligence in the work of open source intelligence (OSINT) professionals is an area that should not be underestimated.

Awesome Tips by Aida Kokanovic:

Large volumes of data can be gathered and analyzed quickly and accurately thanks to artificial intelligence. This gives OSINT researchers new opportunities and gives them access to a wealth of open sources that can provide insightful information.

https://github.com/pollonegro/eyeOnTheSky?source=post_page-----6f582eb420a0--------------------------------

However, AI can be limited in understanding context and semantics, which can lead to ambiguity during analysis:

  • Pre-Investigation Phase: ChatGPT can be leveraged to set up automated data collection processes and provide initial insights on potential subjects or targets.

  • Information Analysis: Specialists can utilize ChatGPT to perform in-depth analysis, identify connections, and generate summaries based on collected data, saving time and effort.

  • Investigative Collaboration: ChatGPT facilitates interactive conversations with other investigators, improving teamwork and enabling the pooling of collective expertise.

  • Real-Time Monitoring: AI-powered chatbots can continuously monitor sources, alerting specialists to emerging risks, detect misinformation or disinformation campaigns, and identify social engineering attempts.

Working with AI in OSINT allows one to see both passion and choppiness in the application of technology. The new capabilities of AI and its potential to increase operational efficiency may excite professionals. But it’s crucial to remember that AI is still in its infancy and that using it can be confusing and lead to ethical and moral dilemmas.

https://medium.com/@singhn_3/chatgpt-or-bettergpt-osint-investigation-using-openai-2f02ccc55af5?source=post_page-----6f582eb420a0--------------------------------

OSINT specialists need to change as the digital world grows in order to efficiently navigate the intricate web of information that is available to them. By adopting ChatGPT and other AI (or, let’s say, any LLM) technologies, OSINT practitioners can greatly improve data collection, analysis, and collaboration. By incorporating AI into OSINT processes, professionals can gain more insight, outwit adversaries, and ultimately protect people, groups, and societies from new threats in the digital sphere!

Check out LLM OSINT which is a proof-of-concept method of using LLMs to gather information from the internet and then perform a task with this information:

https://github.com/sshh12/llm_osint?source=post_page-----6f582eb420a0--------------------------------

We won’t delve into great detail about each of these in this post, but I will provide a few links at the end so you can learn more!


Basic Tips By officercia.eth

OpenAI’s cutting-edge language model, ChatGPT, gives OSINT experts an effective tool for automating anomaly detection and data analysis. By analyzing large volumes of data and identifying irregularities or strange patterns, ChatGPT can dramatically accelerate the identification of anomalies. It can do this by producing human-like responses in natural language.

arxiv.org/pdf/1911.05195.pdf

OSINT specialists can leverage AI-powered chatbots like ChatGPT to integrate multiple data sources and analyze them in a unified manner. By feeding the chatbot with relevant information, it can access various data repositories and perform real-time cross-referencing to identify any anomalies or discrepancies. This approach allows for faster and more accurate anomaly detection across diverse data sets.

AI-powered chatbots excel at understanding context and various types of information. OSINT specialists can employ ChatGPT to analyze structured and unstructured data, including text, images, and even multimedia content. By understanding the meaning and connections between different pieces of information, ChatGPT can assist in identifying anomalies that may not be immediately obvious, such as spelling & grammar mistakes, hidden patterns or relationships.

Moreover, by utilizing face recognition algorithms powered by AI, OSINT experts can identify individuals in images or videos and cross-reference them against known databases. This can help identify individuals operating under false identities or detect potential threats based on facial recognition matches that would have gone unnoticed through traditional methods.

The application of AI to OSINT, specifically ChatGPT and face recognition, perfectly illustrates a great opportunity to identify anomalies across a range of fields. OSINT specialists can expedite the identification of irregularities or suspicious activities by automating data integration, analysis, and anomaly detection through the use of AI-powered chatbots.

Additionally, the incorporation of face recognition technology strengthens the ability to detect anomalies through visual identification. As technology continues to advance, the synergy between AI and OSINT will undoubtedly play a crucial role in improving anomaly detection capabilities.

In general, application of AI in image processing in OSINT allows to significantly expand the range of possibilities and improve the quality of work of analysts and specialists. Machine learning algorithms and neural networks are used for automatic selection and analysis of objects in images, identification of faces and recognition of their characteristics.

However, it is worth noting that image processing and face recognition in OSINT cannot completely replace manual work and expert opinion of the researcher. At times, artificial intelligence can make mistakes or misinterpret information. Therefore, it is important to apply AI as an additional tool that helps reduce time and effort when analyzing large amounts of data.

Possible Issues

Keep in mind that like any other sophisticated, contemporary technology, AI cannot exist in a vacuum. Workflows must incorporate it and take into account both its advantages and disadvantages. It is also important to remember that, in order to guarantee the precision and dependability of the outcomes, every decision made with AI, ML, or LLM needs to be thoroughly examined and validated.

I’d also like to point out some fundamental guidelines for you: use a variety of criteria when evaluating information, and always be aware of your “base settings” because it’s beneficial to your mental well-being and the information you discover shouldn’t destroy your foundation!

Daily Training Tips

Begin by reviewing your own information and data; conduct an OSINT investigation against yourself with using mentioned tools & services. Gather all the data, make it visible, and then remove it using SERM/ORM methods.

SERM/ORM (search engine reputation marketing or reputation management) and Counter-OSINT — do exist, and one of the most interesting areas of which is to work with adding fake or confusing information about yourself in “leakages” or, for example, attaching to your number 100+ names related to taxi services through various GetContact accounts, to confuse potential bad actors who will try to research data on you in the future, in preparation for an attack.

Apply OSINT where it appears to be less obvious by practicing it and doing so in your daily life, as described below:

https://osintteam.blog/dork-yourself-before-someone-does-aa49d0c1929f

Remember, Your task for this final step is to make a plan for maintaining and improving your OSINT skills. Choose some resources for continuous learning, find some challenges to participate in, and consider joining an OSINT community.

https://medium.com/@aidakokanovic/utilizing-chatgpt-for-osint-investigations-8299ce16dd28?source=post_page-----6f582eb420a0--------------------------------

These are important:

  • Curiosity;

  • Search engines/dorks/crawlers;

  • Meta-data;

  • Source code;

  • Reverse image searching;

  • Maps, geo-data;

  • Ability to think differently.

Lastly, review your ethical guidelines to ensure you are always working responsibly and respectfully!

https://medium.com/the-sleuth-sheet/the-open-source-intelligence-analysis-bookshelf-942dc05a16bd?source=post_page-----6f582eb420a0--------------------------------

Reading ‘Grey Literature’

A term you may come across in the realm of OSINT is ‘grey literature’. These are internal documents not intended for public use, but unfortunately, they can easily end up in places where they are searchable.

Examples include technical reports, newsletters, invoices, business proposals, or requests for proposals:

https://medium.com/heptabase/the-best-way-to-acquire-knowledge-from-readings-abf9357814d1?source=post_page-----6f582eb420a0--------------------------------

Understanding the value of your organisation’s information, potential attack vectors, and who might be targeted in phishing attacks or other types of social engineering is essential. OSINT can also aid you in assessing these risks and planning appropriate defences.

OSINT Revolution

arxiv.org/pdf/2310.07298v1.pdf

OSINT has revolutionized the world of investigations, empowering individuals and organizations to uncover valuable information, solve complex problems, and make informed decisions. The ability to harness the vast amount of data available in open sources has opened up new possibilities and transformed the investigative landscape.

https://imshewale.medium.com/top-15-best-ctf-for-osint-practice-89b3f274565a?source=post_page-----6f582eb420a0--------------------------------

By utilizing OSINT tools effectively, investigators can save time, gather comprehensive information, and uncover connections that may have otherwise remained hidden.

The techniques and methodologies explored in this guide provide a roadmap for conducting thorough and successful OSINT investigations via ChatGPT:

https://medium.com/the-sleuth-sheet/the-new-osint-cheat-code-chatgpt-cd54c190fa11?source=post_page-----6f582eb420a0--------------------------------


Choosing a Pathway to Follow

As OSINT specialists navigate the evolving landscape of information gathering and analysis, the integration of ChatGPT and AI technologies offers immense possibilities. While AI can undoubtedly streamline certain aspects of OSINT, human expertise and ethical considerations remain paramount to ensure the integrity and accuracy of investigative practices.

https://www.maltego.com/blog/what-is-open-source-intelligence-and-how-to-conduct-osint-investigations/?source=post_page-----6f582eb420a0--------------------------------#keeping-the-osint-mindsetalways-start-with-a-question

On the other hand, by harnessing the power of AI responsibly, OSINT specialists can uncover new insights, address emerging challenges, and pave the way for more robust investigative outcomes.

OSINT Mindset Explained

I want to state that I will consider OSINT as a set of skills or a mindset, because it can be directly related to, for example, military GEO-INT or just media OSINT performed by a VC fund employee in order to find new projects for investment or even a crypto-forensics specialist investigating a major Web3.0 hack case.

In other words, it can be used in all spheres of life because it is only a method of working with, assessing and ranking information — do not ever forget that we are all living in the Information Era.

https://dorksearch.com/blog/future-of-osint-people-searching/?source=post_page-----6f582eb420a0--------------------------------

Keep in mind, this essay is intended to be instructional! Consider your actions carefully or you will be prosecuted or worse! Always keep in mind Ethics & related Laws — like GDPR, etc…

You should not romanticize OSINT and on-chain investigations in the same manner that individuals often romanticize hacking and warfare, I highly encourage you!

As the battle against disinformation intensifies, OSINT practitioners must be vigilant in protecting themselves from manipulation. By adopting a critical mindset, diversifying information sources, verifying social media information, utilizing fact-checking tools, staying updated on disinformation techniques, collaborating with trusted communities, educating others, maintaining ethical standards, and cross-checking information, OSINT specialists can fortify themselves against manipulation and uphold the integrity of their research.

Last but not least, everything you do is based on the outcomes you need to achieve! You should be able to select reliable and vetted sources instead of using all the tools and links.

It is also crucial to note that OSINT is merely another means to learn about the world around you and is not a way to “get paid instantly.” Always take a break to recharge! Your health & mind are important! This information does not make you better or worse.

Humanity as a species has a proclivity to adapt to its surroundings, which, as we all know, begins with knowledge, observations, and methodology. Take care of yourself, consider the consequences of your actions, and respect the privacy of others. Do not cross your own red lines!

Always think twice before acting, follow the law, and follow the OpSec rules. If you want to help or conduct social investigations but lack experience, please reach out to more experienced people so that you do not harm the victims or those attempting to save them.

In my articles, on the other hand, I reveal a different application of OSINT, inspired by due diligence and civil financial intelligence, with a focus on civilian applications. That is my vision, which I hope you will embrace…

http://cryptojobslist.com/blog/how-to-build-career-in-crypto-web3-forensics?source=post_page-----6f582eb420a0--------------------------------#intro

All of what I said above you can develop in yourself, but the essence of all directions is the same — the ability to notice valuable information, anomalies, see the differences, carefully analyze the facts and build a logical chain — while being in the flow of information.


Related Tools & Services

Bonus Toolset: UX Core

A friend of mine, who, among many other cool things, created an absolute killer used by Product Managers at FAANG.

It’s a free tool to dive deep into cognitive science and human behavior, as well as a practical guide on how to use it. Check it out:

https://keepsimple.io/uxcore?source=post_page-----6f582eb420a0--------------------------------

Top OSINT Specialists


If you want to support my work, please consider donating me to the address:

You can also send me a donation to the address from this repository!

Thank you!