Market intelligence (MI) is gathering and analyzing information relevant to a company'smarket -trends,competitor andcustomer (existing, lost and targeted) monitoring.[1] It is a subtype ofcompetitive intelligence (CI), which isdata andinformation gathered by companies that provide continuous insight into market trends such as competitors' and customers' values and preferences.[1]
MI along with themarketing capabilities of an organization provides a guideline into the allocation and implementation of resources and processes.[2] It is used for the purpose of continuously supplyingstrategic marketing planning for organizations to gaugemarketing positions in order for companies to gaincompetitive advantage and best meet objectives.[3][1]
Organizations can develop MI frameworks and models that are suited to financial capabilities and desiredmarket sectors but are mainly based on the four-step process of collection, validation, processing and communication of MI.[4] The gathering of MI data is sorted into many different categories, including, but not limited to,qualitative,quantitative, formal, informal, published, and unpublished.[5] MI data is gathered both internally and externally.[5]
Benefits that MI can bring are that it providescustomer,competitor and market insights allowingorganizations to gain acompetitive advantage in theirmarketing strategies.[1] Issues that MI can bring is through acquiringdata and information through illegal or unethical ways, it can lead to financial loss andgovernment regulatory failures.[6]
MI and its broader term,marketing intelligence, was first introduced in “Marketing Intelligence for Top Management” by Kelley,[7] to provide information that was analyzed, reliable and consistent for an organization to better createpolicies and makebusiness decisions.[7]
Following Kelley, in “How to Develop a Marketing Intelligence System”, R. Pinkerton shows the proactiveness of organizations asmarketing intelligence systems is applied whilst thetechnological revolution arises.[8] Contributions to MI include professional organizations such as “Global Intelligence Alliance” and “the Society of Competitive Intelligence Professionals” (SCIP).[9] These organizations have contributed bothempirical andtheoretical research in an attempt to further define and understand MI.[9]
As research into MI comes fromscholars and non-scholars of different backgrounds it has resulted in a fragmented state of research. This has led to MI being used interchangeably with other market terms such ascompetitive intelligence,business intelligence andstrategic intelligence.[9] MI to this current date continues to change to meet organizational requirements.[7]
The implementation of MI varies depending on howorganizations perceive it.[3] MI is defined as being composed of three main activities, these activities are Information Acquisition, the gathering ofmarketing information that is required for current and future customer needs, Information Analysis which is the intelligence gained from the information collected and Information Activation, which is using the intelligence to implement and develop marketing plans.[5]
Frameworks can be flexible, however the basis thatorganizations use to model the MI surrounds a four-step process, which are, collection, validation, processing and communication.[4]Data mining techniques are used throughout the processes to aid in the gathering and analyzing ofdata and information retrieved.[citation needed] MI is a continuous process that organizations need to keep track of to improve their strategic and tacticalmarketing planning.[10] These processes target the three activities that MI is defined by.[5] The model can be adjusted and adapted when required and can be implemented all at once or by sections.[3]
Collection is the first step in the MI model, it involves the gathering ofdata andinformation of a particularmarket sector.[3] Suchdata and information can be gathered from external sources, such as other organisations and theirmarket strategies,research institutes andbusiness reports.[3]
Internal factors can include looking into current strategy processes and personal customer trends.[3] It is estimated that 70% to 80% ofintelligence resides withinorganizations employees or, internal MI network, as they are the team who gains information's when interacting withsuppliers, customers and other industry contacts.[11] To involveemployees into an intelligence program to gaindata andinformation the following considerations can be noted: developing a rewards program to promote participation, providing MI goals, requirements and a timeframe for information to be given in and creating a propercommunication method to promote the intelligence program with employees such as using ane-mail system.[12][13]

Validation is the second step in the MI model, this which can be referred to as data cleansing.[3][15] The maintenance of gooddata quality is important asdata and information is being retrieved from many different sources.[15]Data andinformation obtained from sources can bedirty, meaning that it is incomplete, wrong, inappropriate, duplicated.[3] This step will allowdata andinformation to be adjusted and understandable to the organization, furthermore it allows for consistency and compliance to be present.[3] Ifdata quality is not maintained correctly it can lead to organizational losses withrevenue and governmentalregulation failures.[6]
Data cleansing is a complex process that involves several stages in order to get gooddata quality for MI strategy use.[15] Stages include defining the organization's level ofdata quality, detecting error from the data collected and then repairing the errors.[16] The five stages of data cleansing are data analysis to identify errors, eliminating the errors, checking to ensure elimination of error are done appropriately, refreshing the data in thedata warehouse and finally replacing thedirty data with clean data.[17]
Processing is the third step in the MI model.[4] It involves the use of translating the clean data using organizational rules, modelling, logic and analysis to produce readable information, reports and spreadsheets that allows the organization to gain specified knowledge.[3] The interpretation of data into readable information is difficult as it is complex, it requires proper technology and heavy commitment from a top organizational level to match data and information gained and align it to a marketing strategy.[18]
Communication is the last step in the MI model. It involves the sharing, delivering and transmission of information gained from the processing step to figures in the organization who will apply it accordingly to themarket strategy.[19] As MI is a continuously changing, the communication of the MI strategy requires managers whom have expertise in the given market industry in order to determine the ongoingvalidity of the MI strategy and its implementation.[20] In order to make the communication of the MI strategy as successful as possible, this process must be performed by every level of an organization, also known as the intelligence organization.[8]
Intelligence organization refers to the “people and information resources who make the market intelligence process happen”.[1] The five elements of an intelligence organization are, MI leadership who manages and leads the MI process, a MI team, a portfolio of external information sources that is set up by the MI team, internal MI network made up of MI users and the MI user's personal information source network.[1] An intelligence organization element is made up of external and internal factors that allows for a continuous MI process.[1][8]

The gathering of MI data is different dependent on an organization's financial capabilities. Sources ofdata and information is separated intoqualitative,quantitative, formal, informal, published and unpublished. With such sources being retrieved both internally and externally from the organization.[8] It involves usingsearch engines and corporate web sites to see competitor's strategies, identifying business trends throughreputable publications and existing customer clientele.[21] Organizations use different systems to gather MI, one system is that is used isOpen-source Intelligence system.[22]
Sources of internal intelligence gathering include but are not limited to, gatheringdata from customers, manufacturers, throughresearch and development (R&D),employees, also known as salesforce, physical evidence,sales quotes, sales records,trade shows and new hires.[23] Thesedata sources were ranked by organizations on a scale measuring five for being very important to one being not important. It was founded that customers and manufacturers andR&D are the most important to organizations with one hundred percent of organizations ranking these data sources with the number four or higher[24],. It shows that in the process of collection and gathering MIdata and information, thesedata sources brought the mostvalue to organizations.
Sources of external intelligence gathering is included but is not limited to, gatheringdata from client meetings, dealers/distributors,customers, business associates,market research projects, suppliers, online services, periodicals and government publications.[23] Thesedata sources were compared on the same scale as internal intelligence gathering sources, with results showing that intelligence gathered through client meetings being the most important to organizations, with one hundred percent of organizations ranking thisdata source with the number four or higher.[24]
Marketing information systems allow for organizations to continuously acquire, generate, and maintain external and internal information.[25] They are systems that make use ofartificial intelligence (AI) technology to aid in the planning ofstrategic and tacticalmarketing strategy of MI but also share marketing expertise.[25]
Open-source intelligence is a predominant form of MI gathering that organizations employ.OSINT is defined as the scanning, finding, gathering, exploitation, validation, analysis, and sharing with intelligence-seeking clients of publicly available print and digital/electronicdata fromunclassified,non-secret, andgrey literature.[26] It is frequently used as its system is user friendly, its inexpensive and that it processes an abundant amount ofraw materials that can be further processed.[22]
Using MI can bring to organizations both benefits and issues depending on how MI is acquired, maintained, and implemented. Benefits that MI can bring includes but is not limited to gainingcompetitive advantage in theirmarketing strategies.[1] Issues that MI can bring can include but is not limited to, financial losses and government regulatory failures.[3]
There are issues that arises in the process of acquiring MI data and information and the implementation of an organizationsmarketing strategy. Issues such as the acquiring intelligence unethically and illegally can lead to failures withgovernment regulations, also, ifdirty data is not properly cleansed and problems aren't mitigated or resolved can lead to a range of negative impacts that can result in financial and reputational losses to the organization.[3][6]
An issue that can arise is the unethical and illegal collection ofdata and information. Organizations can collect data for MI illegally or unethically to try to gaincompetitive advantages; this is known asindustrial espionage.[28] An example of illegal MI collection practice is whenBritish Airways breached the Data Protect Act 1984 through accessingVirgin's confidential flight details.[29][3]
A standard of conduct was developed by thenon-for-profit organization Society of Competitive Intelligence Professionals, creating a code of ethics that can be adhered to by organizations when collecting market intelligence, to prevent the illegal and unethical collection of data and information.[3]
Dirty data that is collected needs to be cleansed to maintain gooddata quality. Challenges that arise indata cleansing is that there is a large volume of data being received leading to organizations being faced with many risks of failure to detectdirty data being processed through.[30] If data quality is not managed properly, it can result in financial losses, inefficient implementation of MI strategies and failure to comply with government regulations.[31] A reason for financial loss is dueoperational costs, as there is an increase in resources and time spent to identify and fix thedirty data.[6]
MI processes have been used in many organization's strategic market planning, however, there are still difficulties in what the hard and soft benefits in using a MI process for an organization.[1] The benefits of a successful MI process can be sectioned into three categories, better and faster decisions, time and cost savings and organizational learning and new ideas, however, overall, it can improveprofitability and the competitiveness of an organization.[1] The competitiveness of an organization increases as with more MI gathered it'll provide a way for organizations to innovate through improving current methods and increasing the ability to find and create new products.[32]
{{cite journal}}:Cite journal requires|journal= (help){{citation}}: CS1 maint: work parameter with ISBN (link){{cite book}}: CS1 maint: multiple names: authors list (link) CS1 maint: numeric names: authors list (link)