Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Problems uncovered with the HuggingFace demo#190

rumcode started this conversation inGeneral
Discussion options

Before the HuggingFace demo got paused, I was able to run it a couple of times and found a bunch of problems with the results. I was hoping to run it more to get a better sample, I ran it for Apple (AAPL). Here are the results so far.
First, it misreports market cap and shares outstanding because it does not tell you its in millions, thousands etc.
Second, every time I ran it the results were different. From a research standpoint, since the results can not be replicated, then it can't be considered reliable. Third, the results (information from archived articles) is not dated nor referenced. So It's impossible to tell the quality of the information or its age used in the analysis. Some of the data sources that you cite in the article are rather dubious for their quality. So this impacts the analysis. Fourth, it seems to take headlines from articles to reach conclusions. Sometimes news article headlines are attention grabbers such as Apple's debut to equity ratio as being risky. The article may moderate its stance by considering other factors in the text of the article, but the demo does not recognize that and so reaches a poor conclusion. Fifth, sometimes it gets the financial ratio analysis completely wrong and hence reaches the wrong conclusions. Sixth depending upon what information it bases its analysis, it might suggest the stock return will be positive or negative. This obviously will confuse the anyone.

My suggestion to you is let query run a couple of times and see if you obtain the same findings.

You must be logged in to vote

Replies: 1 comment

Comment options

Attached are two output files from running the demo for Apple and Microsoft
AAPL20240710.txt
MSFT20240711.txt

Dates of running it are AAPL: 7/10/2024, MSFT: 7/11/2024

You must be logged in to vote
0 replies
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Category
General
Labels
None yet
1 participant
@rumcode

[8]ページ先頭

©2009-2025 Movatter.jp