Home
last modified time | relevance | path

Searched full:precision (Results 1 – 25 of 1498) sorted by relevance

12345678910>>...60

/OK3568_Linux_fs/prebuilts/gcc/linux-x86/arm/gcc-arm-10.3-2021.07-x86_64-arm-none-linux-gnueabihf/lib/gcc/arm-none-linux-gnueabihf/10.3.1/plugin/include/
H A Dwide-int.h24 mathematical operations on finite precision integers. wide_ints
29 The actual precision of a wide_int depends on the flavor. There
33 precision of its input arguments. It is assumed (and checked)
36 bits above the precision that has been specified. Because of
43 to extend a value beyond the precision specified in the mode.
56 2) offset_int. This is a fixed-precision integer that can hold
61 of precision. We round this up to 128 bits for efficiency.
62 Values of type T are converted to this precision by sign- or
80 infinite precision math. However, it is not really infinite
81 precision math as in the GMP library. It is really finite
[all …]
H A Ddouble-int.h24 It therefore represents a number with precision of
26 internal representation will change, if numbers with greater precision
36 You may also represent with numbers in smaller precision using double_int.
38 number over the prescribed precision with zeros or with the sign bit) before
39 operations that do not perform arithmetics modulo 2^precision (comparisons,
46 numbers with precision higher than HOST_WIDE_INT). It might be less
109 /* The following operations perform arithmetics modulo 2^precision, so you
111 numbers with precision less than HOST_BITS_PER_DOUBLE_INT bits. */
143 of the following operations, if the precision of the numbers
158 /* Precision control functions. */
[all …]
/OK3568_Linux_fs/prebuilts/gcc/linux-x86/aarch64/gcc-arm-10.3-2021.07-x86_64-aarch64-none-linux-gnu/lib/gcc/aarch64-none-linux-gnu/10.3.1/plugin/include/
H A Dwide-int.h24 mathematical operations on finite precision integers. wide_ints
29 The actual precision of a wide_int depends on the flavor. There
33 precision of its input arguments. It is assumed (and checked)
36 bits above the precision that has been specified. Because of
43 to extend a value beyond the precision specified in the mode.
56 2) offset_int. This is a fixed-precision integer that can hold
61 of precision. We round this up to 128 bits for efficiency.
62 Values of type T are converted to this precision by sign- or
80 infinite precision math. However, it is not really infinite
81 precision math as in the GMP library. It is really finite
[all …]
H A Ddouble-int.h24 It therefore represents a number with precision of
26 internal representation will change, if numbers with greater precision
36 You may also represent with numbers in smaller precision using double_int.
38 number over the prescribed precision with zeros or with the sign bit) before
39 operations that do not perform arithmetics modulo 2^precision (comparisons,
46 numbers with precision higher than HOST_WIDE_INT). It might be less
109 /* The following operations perform arithmetics modulo 2^precision, so you
111 numbers with precision less than HOST_BITS_PER_DOUBLE_INT bits. */
143 of the following operations, if the precision of the numbers
158 /* Precision control functions. */
[all …]
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/icelake/
H A Dfloating-point.json16precision floating-point instructions retired; some instructions will count twice as noted below. …
23precision floating-point instructions retired; some instructions will count twice as noted below. …
27precision floating-point instructions retired; some instructions will count twice as noted below. …
34precision floating-point instructions retired; some instructions will count twice as noted below. …
38precision floating-point instructions retired; some instructions will count twice as noted below. …
45precision floating-point instructions retired; some instructions will count twice as noted below. …
49precision floating-point instructions retired; some instructions will count twice as noted below. …
56precision floating-point instructions retired; some instructions will count twice as noted below. …
60precision floating-point instructions retired; some instructions will count twice as noted below. …
67precision floating-point instructions retired; some instructions will count twice as noted below. …
[all …]
/OK3568_Linux_fs/kernel/drivers/firmware/efi/libstub/
H A Dvsprintf.c315 int precision; /* min. # of digits for integers; max in vsnprintf() local
356 /* get the precision */ in vsnprintf()
357 precision = -1; in vsnprintf()
360 precision = get_int(&fmt, &args); in vsnprintf()
361 if (precision >= 0) in vsnprintf()
385 precision = INT_MAX; in vsnprintf()
389 precision = len = 1; in vsnprintf()
395 if (precision < 0) in vsnprintf()
396 precision = INT_MAX; in vsnprintf()
399 s = precision < 6 ? "" : "(null)"; in vsnprintf()
[all …]
/OK3568_Linux_fs/yocto/poky/meta/recipes-kernel/systemtap/systemtap/
H A D0001-PR28778-gcc-warning-tweak-for-sprintf-precision-para.patch7 Subject: [PATCH] PR28778: gcc warning tweak for sprintf precision parameter
9 A precision=-1 sentinel value got interpreted as UINT_MAX in a
29 - len = strnlen(ptr, precision);
30 + len = strnlen(ptr, clamp_t(size_t, precision, 0, STP_BUFFER_SIZE));
32 else if (precision > 0)
33 len = precision;
34 @@ -410,7 +410,7 @@ _stp_vsprint_memory_size(const char * ptr, int width, int precision,
38 - len = strnlen(ptr, precision);
39 + len = strnlen(ptr, clamp_t(size_t, precision, 0, STP_BUFFER_SIZE));
41 else if (precision > 0)
[all …]
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/skylakex/
H A Dfloating-point.json3precision floating-point instructions retired; some instructions will count twice as noted below. …
12precision floating-point instructions retired; some instructions will count twice as noted below. …
21precision floating-point instructions retired; some instructions will count twice as noted below. …
30precision floating-point instructions retired; some instructions will count twice as noted below. …
39precision floating-point instructions retired; some instructions will count twice as noted below. …
48precision floating-point instructions retired; some instructions will count twice as noted below. …
68precision floating-point instructions retired; some instructions will count twice as noted below. …
77precision floating-point instructions retired; some instructions will count twice as noted below. …
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/cascadelakex/
H A Dfloating-point.json3precision floating-point instructions retired; some instructions will count twice as noted below. …
12precision floating-point instructions retired; some instructions will count twice as noted below. …
21precision floating-point instructions retired; some instructions will count twice as noted below. …
30precision floating-point instructions retired; some instructions will count twice as noted below. …
39precision floating-point instructions retired; some instructions will count twice as noted below. …
48precision floating-point instructions retired; some instructions will count twice as noted below. …
68precision floating-point instructions retired; some instructions will count twice as noted below. …
77precision floating-point instructions retired; some instructions will count twice as noted below. …
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/broadwellx/
H A Dfloating-point.json27 …ar double precision floating-point instructions retired. Each count represents 1 computation. App…
36 …ar single precision floating-point instructions retired. Each count represents 1 computation. App…
45precision floating-point: ADD SUB MUL DIV MIN MAX RSQRT RCP SQRT FM(N)ADD/SUB. FM(N)ADD/SUB instru…
54 …d double precision floating-point instructions retired. Each count represents 2 computations. App…
63 …d single precision floating-point instructions retired. Each count represents 4 computations. App…
72 …d double precision floating-point instructions retired. Each count represents 4 computations. App…
81 …X computational double precision floating-point instructions retired. Applies to SSE* and AVX*scal…
90 …d single precision floating-point instructions retired. Each count represents 8 computations. App…
99 …X computational single precision floating-point instructions retired. Applies to SSE* and AVX*scal…
108precision floating-point: ADD SUB HADD HSUB SUBADD MUL DIV MIN MAX SQRT DPP FM(N)ADD/SUB. DPP and…
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/broadwell/
H A Dfloating-point.json32 …ar double precision floating-point instructions retired. Each count represents 1 computation. App…
41 …ar single precision floating-point instructions retired. Each count represents 1 computation. App…
50precision floating-point: ADD SUB MUL DIV MIN MAX RSQRT RCP SQRT FM(N)ADD/SUB. FM(N)ADD/SUB instru…
59 …d double precision floating-point instructions retired. Each count represents 2 computations. App…
68 …d single precision floating-point instructions retired. Each count represents 4 computations. App…
77 …d double precision floating-point instructions retired. Each count represents 4 computations. App…
86 …X computational double precision floating-point instructions retired. Applies to SSE* and AVX*scal…
95 …d single precision floating-point instructions retired. Each count represents 8 computations. App…
104 …X computational single precision floating-point instructions retired. Applies to SSE* and AVX*scal…
113precision floating-point: ADD SUB HADD HSUB SUBADD MUL DIV MIN MAX SQRT DPP FM(N)ADD/SUB. DPP and…
/OK3568_Linux_fs/prebuilts/gcc/linux-x86/aarch64/gcc-arm-10.3-2021.07-x86_64-aarch64-none-linux-gnu/lib/gcc/aarch64-none-linux-gnu/10.3.1/include/
H A Dfloat.h139 precision of the type
141 to the range and precision of the double type, evaluate
143 precision of the long double type
145 precision of the long double type
151 at most the range and precision of float, to the range and
152 precision of float; evaluate all other operations and constants
153 to the range and precision of the semantic type.
155 at most the range and precision of double, to the range and
156 precision of double; evaluate all other operations and constants
157 to the range and precision of the semantic type.
[all …]
/OK3568_Linux_fs/prebuilts/gcc/linux-x86/arm/gcc-arm-10.3-2021.07-x86_64-arm-none-linux-gnueabihf/lib/gcc/arm-none-linux-gnueabihf/10.3.1/include/
H A Dfloat.h139 precision of the type
141 to the range and precision of the double type, evaluate
143 precision of the long double type
145 precision of the long double type
151 at most the range and precision of float, to the range and
152 precision of float; evaluate all other operations and constants
153 to the range and precision of the semantic type.
155 at most the range and precision of double, to the range and
156 precision of double; evaluate all other operations and constants
157 to the range and precision of the semantic type.
[all …]
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/broadwellde/
H A Dfloating-point.json27 …ar double precision floating-point instructions retired. Each count represents 1 computation. App…
36 …ar single precision floating-point instructions retired. Each count represents 1 computation. App…
45 …nstructions retired. Applies to SSE* and AVX* scalar, double and single precision floating-point: …
54 …d double precision floating-point instructions retired. Each count represents 2 computations. App…
63 …d single precision floating-point instructions retired. Each count represents 4 computations. App…
72 …d double precision floating-point instructions retired. Each count represents 4 computations. App…
81 …X computational double precision floating-point instructions retired. Applies to SSE* and AVX*scal…
90 …d single precision floating-point instructions retired. Each count represents 8 computations. App…
99 …X computational single precision floating-point instructions retired. Applies to SSE* and AVX*scal…
108 …structions retired. Applies to SSE* and AVX*, packed, double and single precision floating-point: …
/OK3568_Linux_fs/external/rknpu2/examples/3rdparty/opencv/opencv-linux-aarch64/include/opencv2/flann/
H A Dindex_testing.h139 … int checks, float& precision, const Distance& distance, int nn = 1, int skipMatches = 0)
143 Logger::info(" Nodes Precision(%) Time(s) Time/vec(ms) Mean dist\n");
148precision = search_with_ground_truth(index, inputData, testData, matches, nn, checks, time, dist, …
156 … float precision, int& checks, const Distance& distance, int nn = 1, int skipMatches = 0)
161 Logger::info(" Nodes Precision(%) Time(s) Time/vec(ms) Mean dist\n");
173 if (p2>precision) {
179 while (p2<precision) {
188 if (fabs(p2-precision)>SEARCH_EPS) {
190 // after we got to values in the vecinity of the desired precision
195 while (fabs(realPrecision-precision)>SEARCH_EPS) {
[all …]
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/skylake/
H A Dfloating-point.json8 …ar double precision floating-point instructions retired. Each count represents 1 computation. App…
17 …ar single precision floating-point instructions retired. Each count represents 1 computation. App…
26 …d double precision floating-point instructions retired. Each count represents 2 computations. App…
35 …d single precision floating-point instructions retired. Each count represents 4 computations. App…
44 …d double precision floating-point instructions retired. Each count represents 4 computations. App…
53 …d single precision floating-point instructions retired. Each count represents 8 computations. App…
/OK3568_Linux_fs/kernel/arch/m68k/fpsp040/
H A Dutil.S12 | g_rndpr: returns the rounding precision.
74 | This forces the destination precision to be extended
93 | This sets the round precision according to the user's FPCR unless the
96 | If the instruction is fsgldiv of fsglmul, the rounding precision must be
98 | precision instruction, the rounding precision is then set to the force
99 | precision.
109 beql ovff_sgl |force precision is single
111 beql ovff_dbl |force precision is double
136 | Inst is either fsgldiv or fsglmul. Force extended precision.
149 | The precision is in the fpcr.
[all …]
/OK3568_Linux_fs/u-boot/lib/
H A Dvsprintf.c158 int base, int size, int precision, int type) in number() argument
220 if (i > precision) in number()
221 precision = i; in number()
223 size -= precision; in number()
245 while (i <= --precision) in number()
257 int precision, int flags) in string() argument
264 len = strnlen(s, precision); in string()
277 int precision, int flags) in string16() argument
280 int utf16_len = utf16_strnlen(str, precision); in string16()
298 int precision, int flags) in mac_address_string() argument
[all …]
/OK3568_Linux_fs/buildroot/dl/qt5location/git/src/3rdparty/mapbox-gl-native/deps/boost/1.65.1/include/boost/detail/
H A Dlcast_precision.hpp41 // Calculate an argument to pass to std::ios_base::precision from
135 unsigned long const precision = 2UL + digits * 30103UL / 100000UL; in lcast_get_precision()
140 precision > limits::digits10 + 0UL && in lcast_get_precision()
141 precision <= streamsize_max + 0UL in lcast_get_precision()
143 return precision; in lcast_get_precision()
148 unsigned int const precision = limits::digits10 + 1U; in lcast_get_precision()
149 BOOST_ASSERT(precision <= streamsize_max + 0UL); in lcast_get_precision()
150 return precision; in lcast_get_precision()
154 // Integral type (for which precision has no effect) in lcast_get_precision()
156 // so assume stream precision remains the default 6 decimal digits. in lcast_get_precision()
[all …]
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/ivybridge/
H A Dfloating-point.json13 …"PublicDescription": "Number of SSE* or AVX-128 FP Computational packed double-precision uops issu…
19 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational packed double-precision uops issue…
23 …"PublicDescription": "Number of SSE* or AVX-128 FP Computational scalar single-precision uops issu…
29 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational scalar single-precision uops issue…
33 …"PublicDescription": "Number of SSE* or AVX-128 FP Computational packed single-precision uops issu…
39 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational packed single-precision uops issue…
43 … "PublicDescription": "Counts number of SSE* or AVX-128 double precision FP scalar uops executed.",
49 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational scalar double-precision uops issue…
53 "PublicDescription": "Counts 256-bit packed single-precision floating-point instructions.",
59 … "BriefDescription": "number of GSSE-256 Computational FP single precision uops issued this cycle",
[all …]
/OK3568_Linux_fs/kernel/tools/perf/pmu-events/arch/x86/ivytown/
H A Dfloating-point.json13 …"PublicDescription": "Number of SSE* or AVX-128 FP Computational packed double-precision uops issu…
19 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational packed double-precision uops issue…
23 …"PublicDescription": "Number of SSE* or AVX-128 FP Computational scalar single-precision uops issu…
29 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational scalar single-precision uops issue…
33 …"PublicDescription": "Number of SSE* or AVX-128 FP Computational packed single-precision uops issu…
39 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational packed single-precision uops issue…
43 … "PublicDescription": "Counts number of SSE* or AVX-128 double precision FP scalar uops executed.",
49 …"BriefDescription": "Number of SSE* or AVX-128 FP Computational scalar double-precision uops issue…
53 "PublicDescription": "Counts 256-bit packed single-precision floating-point instructions.",
59 … "BriefDescription": "number of GSSE-256 Computational FP single precision uops issued this cycle",
[all …]
/OK3568_Linux_fs/kernel/arch/alpha/boot/
H A Dstdio.c43 static char * number(char * str, unsigned long long num, int base, int size, int precision, int typ… in number() argument
82 if (i > precision) in number()
83 precision = i; in number()
84 size -= precision; in number()
101 while (i < precision--) in number()
121 int precision; /* min. # of digits for integers; max in vsprintf() local
160 /* get the precision */ in vsprintf()
161 precision = -1; in vsprintf()
165 precision = skip_atoi(&fmt); in vsprintf()
169 precision = va_arg(args, int); in vsprintf()
[all …]
/OK3568_Linux_fs/kernel/arch/x86/boot/
H A Dprintf.c41 static char *number(char *str, long num, int base, int size, int precision, in number() argument
85 if (i > precision) in number()
86 precision = i; in number()
87 size -= precision; in number()
104 while (i < precision--) in number()
124 int precision; /* min. # of digits for integers; max in vsprintf() local
170 /* get the precision */ in vsprintf()
171 precision = -1; in vsprintf()
175 precision = skip_atoi(&fmt); in vsprintf()
179 precision = va_arg(args, int); in vsprintf()
[all …]
/OK3568_Linux_fs/kernel/arch/powerpc/boot/
H A Dstdio.c79 static char * number(char * str, unsigned long long num, int base, int size, int precision, int typ… in number() argument
118 if (i > precision) in number()
119 precision = i; in number()
120 size -= precision; in number()
137 while (i < precision--) in number()
157 int precision; /* min. # of digits for integers; max in vsprintf() local
196 /* get the precision */ in vsprintf()
197 precision = -1; in vsprintf()
201 precision = skip_atoi(&fmt); in vsprintf()
205 precision = va_arg(args, int); in vsprintf()
[all …]
/OK3568_Linux_fs/buildroot/dl/qt5location/git/src/3rdparty/mapbox-gl-native/deps/boost/1.65.1/include/boost/spirit/home/support/detail/math/detail/
H A Dfp_traits.hpp39 single precision (32 bits), double precision (64 bits)
40 and extended double precision (>64 bits)
43 both as double precision and extended double precision.
56 point numbers of C++ type T and precision U
92 // but not the Motorola 68K extended double precision format.
94 // Currently the generic version is used only for extended double precision
171 case 0x3f400000: // IEEE single precision format in do_init_()
179 case 0x3fe80000: // IEEE double precision format in do_init_()
180 // and PowerPC extended double precision format in do_init_()
187 case 0x3ffe0000: // Motorola extended double precision format in do_init_()
[all …]

12345678910>>...60