The methodology of forming technological trends based on the processing of heterogeneous data in general purpose networks

The current stage of scientific research and technology development is characterized by high dynamics of the formation of new directions and technological trends, as well as the trajectories of their development. Along with this, the intensification of global competition puts forward as a priority the task of ensuring technological sovereignty and technological superiority based on the development and implementation of strategies for scientific and technological development at the national and corporate levels. In turn, the development of effective strategies is impossible without solving the problem of analyzing and forming technological trends, studying their characteristics and dynamics of development. This task can be presented in the following form: for a given subject area, identify trends and directions in the development of scientific research and technology based on monitoring and analysis of big data in general and special purpose networks. The known methods and methods of solving the presented problem have several disadvantages: methodological and technological results have not been found that make it possible to create models and methods for the holistic perception of heterogeneous information by a computer system; the time of the analyzed publication is not taken into account, when forming trends, the data may be outdated or not identified in the trend due to the fragmentation of information over time; processing a large amount of information requires a lot of computing power and takes a lot of time. In the presented work, an analysis of methods and methods for identifying trends in scientific and technological development based on monitoring and analysis of information in general and special purpose networks is carried out. The research is based on a new approach to the formation of trends and their subsequent analysis based on the proposed clustering procedure with a time offset. The presented technique provides a solution to the problem associated with the formation of technological trends: Firstly, the use of a given time interval allows: Reduce the amount of data processed; Improve computing efficiency; reduce the processing time of the request. Secondly, splitting the dataset and entering a time offset allows you to: Track trends over time; Provides information about the emergence, evolution and decline of the trend. Third, the use of top2vec models and graphical representations: Makes it easier to identify trends; Visualizes trends in an interpretable way.