Repository files navigation

In the process of software development, many questions arise. Developers often resort to Q&A websites like Stack Overflow to seek answers. Stack Overflow, a part of the Stack Exchange Network, allows users to ask and answer questions, vote on content, and earn reputation points and badges. Higher reputation unlocks additional privileges such as voting, commenting, and editing.

This project involves developing a web application usingSpring Boot to store, analyze, and visualizeStack Overflow Q&A data related to Java programming. The goal is to understand common questions, answers, and resolution activities associated with Java programming.

• Objective: Collect Stack Overflow threads taggedjava.
• Requirement: Gather at least1000 threads.
• Approach:
  • Use Stack Overflow's REST API for data retrieval.
  • Persist data offline in adatabase (PostgreSQL, MySQL, etc.) orlocal files.
  • Avoid on-the-fly API requests; all analysis should be performed on collected data.

Each question in this section requires:

• Identifying relevant data.
• Implementing backend data analysis.
• Visualizing results on the frontend.

Question: What are the top N most frequently asked Java topics on Stack Overflow?

Question: What are the top N topics with the most engagement from high-reputation users?

• Engagement includes edits, answers, comments, upvotes, and downvotes.

Question: What are the top N errors and exceptions frequently discussed by Java developers?

• Classify errors asfatal errors (e.g.,OutOfMemoryError) andexceptions (e.g., checked and runtime exceptions).
• Extract error-related data from thread content using techniques likeregular expressions.

Question: What factors contribute to high-quality answers (accepted or highly upvoted answers)?

• Investigate:
  1. Elapsed time between question creation and first answer.
  2. Reputation of the answering user.
  3. Propose one additional factor affecting answer quality.
• Visualize findings effectively.

Develop aREST API to answer the following questions inJSON format:

1. Topic Frequency: Retrieve the frequency of a specific topic or the top N topics sorted by frequency.
2. Bug Frequency: Retrieve the frequency of a specific error/exception or the top N errors/exceptions sorted by frequency.

• Implement data analysis usingJava Collections, Lambda, and Stream API.
• Backend:Spring Boot.
• Database:PostgreSQL/MySQL (or local files for storage).
• API responses should be inJSON format.

• Start data collection early due to API rate limits and potential instabilities.
• Ensuremeaningful data analysis andeffective visualizations.
• Utilizefrontend charts for presenting insights.

1. Usedocker compose up -d --build to start the services.
2. Run the project.
3. Check theDockerfile configuration for database connection details.

Deadline: 2024-11-10