summaryrefslogtreecommitdiff
path: root/open_issues/binutils/testsuite.mdwn
blob: 4a13868fad1a084b6c77ec57814d62de2ffa6d95 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
[[!meta copyright="Copyright © 2010 Free Software Foundation, Inc."]]

[[!meta license="""[[!toggle id="license" text="GFDL 1.2+"]][[!toggleable
id="license" text="Permission is granted to copy, distribute and/or modify this
document under the terms of the GNU Free Documentation License, Version 1.2 or
any later version published by the Free Software Foundation; with no Invariant
Sections, no Front-Cover Texts, and no Back-Cover Texts.  A copy of the license
is included in the section entitled [[GNU Free Documentation
License|/fdl]]."]]"""]]

[[!tag open_issue_binutils]]

Here's a log of a binutils build and testsuite run; this is from
fb02b34127764596bd182e258400a59356f6cdce (2010-11-24)
[[sources|source_repositories/binutils]], run on kepler.SCHWINGE and grubber.

    $ export LC_ALL=C
    $ ../hurd/configure --prefix="$PWD".install 2>&1 | tee log_build
    [...]
    $ make SHELL=/bin/bash 2>&1 | tee log_build_
    [...]

(kepler.SCHWINGE defaults to using /bin/sh for libtool, grubber to /bin/bash;
thus harmonized.)

On grubber, this takes roughly one hour.

x86 GNU/Linux and GNU/Hurd's configurations are [[slightly
different|binutils]], thus mask out most of the differences that are due to
GNU/Linux defining `-DTRAD_CORE`, `-DHAVE_i386linux_vec`
(`-DSELECT_VECS='[...],&i386linux_vec[...]`), `-DHAVE_i386pei_vec`
(`-DSELECT_VECS='[...],&i386pei_vec[...]`).

    $ diff -wu <(ssh kepler.SCHWINGE 'cd tmp/source/binutils/hurd.build/ && cat log_build* | sed -e "s%${PWD}%[...]%g" -e s%-DTRAD_CORE%% -e s%-DHAVE_i386linux_vec%% -e s%-DHAVE_i386pei_vec%% -e s%-DSELECT_VECS=\\\('\\\''\\\?\\\)\&bfd_elf32_i386_vec,\&i386linux_vec,\&i386pei_vec,\&bfd_elf32_little_generic_vec,\&bfd_elf32_big_generic_vec'\\\''\\\?%-DSELECT_VECS=\\\1\\\&bfd_elf32_i386_vec,\\\&bfd_elf32_little_generic_vec,\\\&bfd_elf32_big_generic_vec\\\1%') <(ssh grubber 'cd tmp/binutils/hurd.build/ && cat log_build* | sed "s%${PWD}%[...]%g"') > open_issues/binutils/testsuite/log_build-diff

[[log_build-diff]].

    $ make -k check
    [...]

On grubber, this takes roughly one hour.

    $ ssh kepler.SCHWINGE 'cd tmp/source/binutils/ && cat hurd.build/*/*.sum hurd.build/*/*/*.sum | sed "s%${PWD}%[...]%g"' > open_issues/binutils/testsuite/sum_linux
    $ ssh grubber 'cd tmp/binutils/ && cat hurd.build/*/*.sum hurd.build/*/*/*.sum | sed "s%${PWD}%[...]%g"' > open_issues/binutils/testsuite/sum_hurd

Comparing the results files, [[sum_linux]] to [[sum_hurd]]:

    $ diff -u -F ^Running open_issues/binutils/testsuite/sum_linux open_issues/binutils/testsuite/sum_hurd
    --- open_issues/binutils/testsuite/sum_linux	2010-11-24 13:01:43.000000000 +0100
    +++ open_issues/binutils/testsuite/sum_hurd	2010-11-25 08:51:52.000000000 +0100
    @@ -1,5 +1,5 @@
    -Test Run By thomas on Wed Nov 24 12:32:00 2010
    -Native configuration is i686-pc-linux-gnu
    +Test Run By tschwinge on Wed Nov 24 12:33:09 2010
    +Native configuration is i686-unknown-gnu0.3
     
     		=== binutils tests ===
     
    @@ -114,8 +114,8 @@ Running [...]/hurd/binutils/testsuite/bi
     
     # of expected passes		83
     # of unsupported tests		2
    -Test Run By thomas on Wed Nov 24 12:32:23 2010
    -Native configuration is i686-pc-linux-gnu
    +Test Run By tschwinge on Wed Nov 24 12:43:48 2010
    +Native configuration is i686-unknown-gnu0.3
     
     		=== ld tests ===
     
    @@ -295,9 +295,9 @@ Running [...]/hurd/ld/testsuite/ld-elf/e
     PASS: preinit array
     PASS: init array
     PASS: fini array
    -PASS: static preinit array
    -PASS: static init array
    -PASS: static fini array
    +XFAIL: static preinit array
    +XFAIL: static init array
    +XFAIL: static fini array
     Running [...]/hurd/ld/testsuite/ld-elf/exclude.exp ...
     PASS: ld link shared library
     PASS: ld export symbols from archive
    @@ -317,7 +317,8 @@ Running [...]/hurd/ld/testsuite/ld-elf/s
     PASS: assignment of ELF sections to segments (disjoint pages)
     Running [...]/hurd/ld/testsuite/ld-elf/sec64k.exp ...
     PASS: ld-elf/64ksec-r
    -PASS: ld-elf/64ksec
    +WARNING: program timed out.
    +FAIL: ld-elf/64ksec
     Running [...]/hurd/ld/testsuite/ld-elf/shared.exp ...
     PASS: Build libfoo.so
     PASS: Build versioned libfoo.so
    @@ -551,8 +552,8 @@ Running [...]/hurd/ld/testsuite/ld-elfwe
     PASS: ELF DSO weak func last DSO
     PASS: ELF weak func first
     PASS: ELF weak func last
    -PASS: ELF weak func first DSO
    -PASS: ELF weak func last DSO
    +XFAIL: ELF weak func first DSO
    +XFAIL: ELF weak func last DSO
     PASS: ELF DSO weak data first
     PASS: ELF DSO weak data last
     PASS: ELF DSO weak data first DSO
    @@ -563,10 +564,10 @@ Running [...]/hurd/ld/testsuite/ld-elfwe
     PASS: ELF weak data last
     PASS: ELF weak data first common
     PASS: ELF weak data last common
    -PASS: ELF weak data first DSO
    -PASS: ELF weak data last DSO
    -PASS: ELF weak data first DSO common
    -PASS: ELF weak data last DSO common
    +XFAIL: ELF weak data first DSO
    +XFAIL: ELF weak data last DSO
    +XFAIL: ELF weak data first DSO common
    +XFAIL: ELF weak data last DSO common
     PASS: ELF DSO small bar (size)
     PASS: ELF DSO foo with small bar (size)
     PASS: ELF DSO big bar (size)
    @@ -871,13 +872,14 @@ Running [...]/hurd/ld/testsuite/ld-xtens
     
     		=== ld Summary ===
     
    -# of expected passes		616
    -# of expected failures		8
    +# of expected passes		606
    +# of unexpected failures	1
    +# of expected failures		17
     # of untested testcases		6
     /media/data[...]/hurd.build/ld/ld-new 2.21.51.20101124
     
    -Test Run By thomas on Wed Nov 24 12:32:05 2010
    -Native configuration is i686-pc-linux-gnu
    +Test Run By tschwinge on Wed Nov 24 12:36:10 2010
    +Native configuration is i686-unknown-gnu0.3
     
     		=== gas tests ===
     


# Analysis

## <a name="static">`FAIL: static [...]`</a>

The testsuite isn't prepared for using `crt0.o` instead of `crt1.o` depending
on whether a static or dynamic executable is created.  Documented in
`ld/configure.host`.  Perhaps we should finally rewrite this messy code in
glibc to avoid this difference...

## <a name="64ksec">`FAIL: ld-elf/64ksec`</a>

On the idle grubber, this one takes a few minutes wall time to complete
successfully ([[I/O system weakness|performance/io_system/binutils_ld_64ksec]],
so assuming
some system load variation, the testsuite's timeout may trigger.

## <a name="weak">`FAIL: ELF weak [...]`</a>

[[I|tschwinge]] suppose this is due to us having an override w.r.t. weak symbol
handling in glibc, needed for our external [[libpthread]].  TODO: document
properly.