Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

Commit0081e81

Browse files
committed
Add expected failures for the tokenizer (except lone surrogates!).
We can't currently add the lone-surrogates tests because theexpected failures file is UTF-8 and we can't have lone-surrogatesthere. Le sigh…
1 parentc66d41e commit0081e81

File tree

2 files changed

+63
-2
lines changed

2 files changed

+63
-2
lines changed
Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
#data
2+
<!DOCTYPE>
3+
4+
#data
5+
<!DOCTYPE >
6+
7+
#data
8+
<!DOCTYPE
9+
10+
#data
11+
<!DOCTYPE
12+
13+
14+
#data
15+
<!DOCTYPE
16+
17+
#data
18+
<!DOCTYPE
19+
20+
#data
21+
<!DOCTYPE
22+
23+
24+
#data
25+
<!DOCTYPE
26+
27+
#data
28+
<!DOCTYPE
29+
30+
#data
31+
<!DOCTYPE
32+
33+
#data
34+
<!DOCTYPE
35+
36+
#data
37+
<!DOCTYPE
38+
39+
#data
40+
I'm &no
41+
42+
#data
43+
<!DOCTYPE

‎html5lib/tests/test_tokenizer.py‎

Lines changed: 20 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,9 @@
33
importjson
44
importwarnings
55
importre
6+
importos
67

7-
from .supportimportget_data_files
8+
from .supportimportget_data_files,TestData,xfail
89

910
fromhtml5lib.tokenizerimportHTMLTokenizer
1011
fromhtml5libimportconstants
@@ -161,6 +162,11 @@ def runTokenizerTest(test):
161162
asserttokensMatch(expected,received,ignoreErrorOrder,True),errorMsg
162163

163164

165+
@xfail
166+
defxfailRunTokenizerTest(*args,**kwargs):
167+
returnrunTokenizerTest(*args,**kwargs)
168+
169+
164170
def_doCapitalize(match):
165171
returnmatch.group(1).upper()
166172

@@ -174,6 +180,14 @@ def capitalize(s):
174180

175181

176182
deftestTokenizer():
183+
# Get xfails
184+
filename=os.path.join(os.path.split(__file__)[0],
185+
"expected-failures",
186+
"tokenizer.dat")
187+
xfails=TestData(filename,"data")
188+
xfails=frozenset([x["data"]forxinxfails])
189+
190+
# Get tests
177191
forfilenameinget_data_files('tokenizer','*.test'):
178192
withopen(filename)asfp:
179193
tests=json.load(fp)
@@ -185,4 +199,8 @@ def testTokenizer():
185199
test=unescape(test)
186200
forinitialStateintest["initialStates"]:
187201
test["initialState"]=capitalize(initialState)
188-
yieldrunTokenizerTest,test
202+
iftest['input']inxfails:
203+
testFunc=xfailRunTokenizerTest
204+
else:
205+
testFunc=runTokenizerTest
206+
yieldtestFunc,test

0 commit comments

Comments
 (0)
[8]ページ先頭
©2009-2025 Movatter.jp