x86emul: adjust 2nd param of idiv_dbl()

-LONG_MIN cannot be represented in a long and hence is UB, for being one
larger than LONG_MAX.

The caller passing an unsigned long and the 1st param also being (array
of) unsigned long, change the 2nd param accordingly while adding the
sole necessary cast. This was the original form of the function anyway.

Fixes: 5644ce0142 ("x86emul: relax asm() constraints")
Oss-fuzz: 70923
Signed-off-by: Jan Beulich <jbeulich@suse.com>
Reviewed-by: Stefano Stabellini <sstabellini@kernel.org>
This commit is contained in:
Jan Beulich committed 2024-08-08 13:27:25 +02:00
1 parent c246155000
commit ef31716a57
1 file changed
+2 -2
+2 -2
View File
@@ -607,9 +607,9 @@ static bool div_dbl(unsigned long u[2], unsigned long v)
* NB. We don't use idiv directly as it's moderately hard to work out
* ahead of time whether it will #DE, which we cannot allow to happen.
*/
static bool idiv_dbl(unsigned long u[2], long v)
static bool idiv_dbl(unsigned long u[2], unsigned long v)
{
bool negu = (long)u[1] < 0, negv = v < 0;
bool negu = (long)u[1] < 0, negv = (long)v < 0;
/* u = abs(u) */
if ( negu )
Reference in new issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.