.net - Floating Point Result Discrepancy Between Two Seemingly Identical Statements

Sep 14, 2011

I've got the following Visual Basic code:

Dim L16, L23, L45, t As Double
Dim LBase, LAdjacent, LOpposite As Double
L16 = 20

[Code].....

Both equations should be equivalent: I've simply replaced L16 with LBase, L23 with LAdjacent and L45 with LOpposite. Yet the first equation outputs 3586 while the second outputs 3587.

View 1 Replies


ADVERTISEMENT

C# - Understanding Floating Point Limitations In Calculations

Jan 12, 2011

How to determine when floating point limitations will cause errors in your calculations. For example the following code.
CalculateTotalTax = function (TaxRate, TaxFreePrice) {
return ((parseFloat(TaxFreePrice) / 100) * parseFloat(TaxRate)).toFixed(4);
};

I have been unable to input any two values that have caused for me an incorrect result for this method. If I remove the toFixed(4) I can infact see where the calculations start to lose accuracy (somewhere around the 6th decimal place). Having said that though, my understanding of floats is that even small numbers can sometimes fail to be represented or have I misunderstood and can 4 decimal places (for example) always be represented accurately.

MSDN explains floats as such... This means they cannot hold an exact representation of any quantity that is not a binary fraction (of the form k / (2 ^ n) where k and n are integers). Now I assume this applies to all floats (inlcuding those used in javascript). How can one determine if any specific method will be vulnerable to errors in floating point operations, at what precision will those errors materialize and what inputs will be required to produce those errors?

View 5 Replies

Floating Point - Displaying A Decimal With A Given Maximum Length?

Apr 28, 2010

I am writing a custom totaling method for a grid view. I am totaling fairly large numbers so I'd like to use a decimal to get the total. The problem is I need to control the maximum length of the total number. To solve this problem I started using float but it doesn't seem to support large enough numbers, I get this in the totals column(1.551538E+07). So is there some formating string I can use in .ToString() to guarentee that I never get more then X characters in the total field? Keep in mind I'm totaling integers and decimals.

View 2 Replies

Regular Expression (RegEx) To Replace Floating-point Numbers In XML?

Aug 22, 2011

I'm using Visual Basic 2010 Express to edit an XML file. I want to replace items that have (typically) non-zero floating point numbers with a single zero.

View 4 Replies

Convert Single Precision Floating Point Numbers To IEEE 754 Hex And Back?

Aug 12, 2009

Private Function SingleToIEEE754Hex(ByVal pValue As Single) As String

[Code]...

View 1 Replies

Interface And Graphics :: Drawing Objects To Picturebox With Floating Point Numbers?

Jul 17, 2009

If I try to draw a circle by using e.g.

Code:
e.Graphics.DrawEllipse(Pens.Red, 50.133, 100.321, 0.1, 0.1)

I will get an error message. I tried something like

Code:
Public ObjectPoint As PointF
Dim cpoint As New PointF()
cpoint.ObjectPoint = New PointF(startX, startY)
e.Graphics.DrawEllipse(Pens.Blue, cpoint.ObjectPoint, 0.4, 0.4)

but it didn't work for the location and the circle size. How to draw a circle(and rectangle) by using floating point numbers?

View 6 Replies

Why Do Simple Math Operations On Floating Point Return Unexpected (inaccurate) Results In .Net And Python

Oct 20, 2009

x = 4.2 - 0.1
vb.net gives 4.1000000000000005
python gives 4.1000000000000005
Excel gives 4.1
Google calc gives 4.1

What is the reason this happens?

View 4 Replies

"invalid Floating Point Operation" Error

May 3, 2010

I think this should be a very basic question. Anyways, when trying to run the script:

[Code]...

I get an "invalid floating point operation" error, and the line "c = Log(a+1.0)/(b/2.0)" gets highlighted. Then, without making any changes whatsoever, I run the script again, and it works perfectly, outputting the value 0.2773... How can I fix this, so that it works right the first time?

View 1 Replies

VB - "If" Statements Not Showing Result In Label

Feb 23, 2012

I'm working on an assignment where the program needs to calculate and display the total cost for shipping a package, based on weight and whether it is being shipped to Continental U.S., Alaska, or Hawaii. When I click the Calculate button, though, the label that is supposed to display the total is left blank. I've looked through this and tried placing the calculation in different parts/at the end of the "If" statements.

Dim decWeight As Decimal
Dim decTotalCost As Decimal
Dim decDestination As Decimal

[Code].....

View 1 Replies

Store Values To A Double-type Variable, And Ask To Display It On The Screen, There Seems To Always Be A Discrepancy?

Mar 16, 2010

Whenever I store values to a double-type variable, and ask to display it on the screen, there seems to always be a discrepancy, for example, I entered 7.416 to a textbox and assigned it to a double. When i ask for it to be displayed, it used to be that the 7.416 is returned to me. But just a few days ago, when I debugged my program again, it returns numbers like 7.4159987.......[code]....

View 7 Replies

Win7/64 Shortcut Discrepancy Between Scripted IconLocation And Change Icon Button

Nov 30, 2010

I am noticing a discrepancy between a full path specified for a VBScript Shortcut IconLocation and the subsequent mangled result that only becomes noticeable when I wish to manually change the Shortcut's Icon. Somewhere after the oShortcut.save call, the mangling occurs.

The icon is always properly displayed on the Shortcut. However, programs that exist only in the 32-bit "C:Program Files (x86)" location result in an error message that states, "Windows can't find the file %ProgramFiles%<etc>." (where <etc> is the remainder of the path).

The Visual Basic Script as well as my Command Prompt both show %ProgramFiles% as "C:Program Files (x86)", yet the Shortcut/Windows Explorer dialog always interpret it as the 64-bit Program directory. This may indicate a low level flawed interaction, a contention of definitions.

Input/Output examples:

IN: Hard coded to the call to oShortcut.IconLocation = "<Full Path>,0"

OUT: The text shown in the error message after I click "Change Icon...".

These ONLY exist in "C:Program Files (x86)":

IN: C:Program Files (x86)AdobeReader 10.0ReaderAcroRd32.exe
OUT: %ProgramFiles%AdobeReader 10.0ReaderAcroRd32.exe

[Code]....

Note the %SystemDrive% adds a further insane mangling of the 64-bit path. This one luckily seems to be a benign error for the moment. The errors are not even consistent. Has anyone at Microsoft ever heard of quality control?

View 2 Replies

VS 2008 Set A Point Without Setting Point.x And Point.y Separately

Jun 4, 2009

I hve been working with points a lot recently, and I have been wondering if there is a way to set a point without setting point.x and point.y separately. For example for (3, 5): Point1 = (3, 5) But that isn't right

View 4 Replies

.Net Win Forms App Crashes Occasionally, Seemingly Randomly?

Jun 2, 2011

I am developing Windows Forms Application SRacq10 in VS2010 in VB.Net. It provides a WCF duplex service and obtains real time financial market data using COM object TWS (Trader Work Station) provided by Interactive Brokers, Inc. SRacq10 works well most of the time. Occasionally, it crashes; I have not been able to observe a pattern of circumstances when it crashes. When I try to add debug to a text file, I can never make it crash; that's not an acceptable solution in the long run. Here is the fault information when running the debug version outside of VS2010:

Event Viewer:
Faulting application name: SRacq10.exe, version: 1.0.0.0, time stamp: 0x4de7a42c
Faulting module name: MSVCR80.dll, version: 8.0.50727.4940, time stamp: 0x4ca2b271

[code]....

View 4 Replies

.net: CInt Returning -1 On A (seemingly Valid) String?

Apr 24, 2009

I have a strange problem where CInt (as well as Convert.ToInt32 or even Val) return -1 for a string "500". Using Gurock's SmartInspect for logging, I've checked all values at runtime (SiAuto... logs something, I'm posting the log below the code).

[Code]...

View 2 Replies

How To Do A Seemingly Simple Object-oriented In .NET 2010

Jun 17, 2010

how to do a seemingly simple object-oriented problem in VB.NET 2010. Basically, I want to be able to write code such that I could do the following:

Dim myObject as Object
myObject.Group1.Command1()
myObject.Group2.Command2()

[code]....

Very similar to how VBA handles objects, such as in Excel, I can use

Dim myBook as Workbook
Set myBook = ActiveWorkbook
myBook.Sheets(1).Range("A1").Value()

to get the value of the cell "A1" on the first sheet. This structure has been eluding me for some time now, and it would be great if anyone could suggest how to do it. I'm currently using a class and declaring all methods as Shared Friend inside subclasses, which throws warnings when I use it as I want to in other code.

View 4 Replies

Program That Will Generate A Pattern Using Do While / If Else Statements / Do Until Statements

Oct 11, 2009

Can someone give me a site to a tutorial that will help me write a program that will generate a pattern using do while, if else statements,and do until statements. I have been using google but I can't find anything. I need to generate patterns a certain size 6 by 6 or similar such as something like a checkerboard but where the ^ symbols is there a suppose to be a blank space..

View 3 Replies

Finding A Point On A Diagonal Line When Have The Start Point And End Point Of The Line?

Feb 14, 2011

I have a Diagonal line drawn on a picture box on my forum and i need to know if the user has clicked the line I have the Start point and End Point of the Line and the mouse x,y location So i basically need to find out if the x,y of the mouse is on the line.

View 2 Replies

VS 2010 : Search For Text Within A String (Starting Point And Ending Point)?

Dec 31, 2010

I'm trying to extract a piece of text from within the string, defining both a starting point and an ending point. For instance, say I want to search for the text found between "That is a " and " car" in the string "That is a red car", so it would return "red".I know you can use .SelectionStart and SelectionLength, but the length of the word can change, so the selection length can vary. What I want is to establish a specific starting point and a specific ending point from which to extract the text from the string.

View 5 Replies

VS 2010 Loop In A Variable And Grab Info From Point A To Point B?

May 24, 2010

I want to know if its possible to loop in a variable and grab info from point a to point b

This is what I have stored in my Variable

PHP
</div> <!-- div reviews end white-space:nowrap; margin-bottom:5px; class="reviews" -->
<div class="list_address">

[Code].....

View 11 Replies

Add Point And Delete Point When The User Clicks The Picture?

Jul 29, 2009

i have a picturebox which displays a map i have 2 modes add point and delete point when the user clicks the picture it creates a point on the picture where the user has clicked that works perfectly its when i try and delete the point when it doesent work :/ i have all the points loading from an xml file this is the code i have:

[Code]...

basicly i want it to when the user clicks the point it fines the x any y in the xml delete the node then delete all the points on the map then reload them all according to the xml

View 9 Replies

Calculating Point-to-point Directions On A 2-D Grid?

Mar 11, 2012

I'm trying to calculate the direction between two points on a two-dimensional grid. Actually I want to determine if that vector is within a range of two values. Suppose the grid's origin is 0,0 at the upper left corner, and 0 degrees represents north. I have a point A on that grid. I want to know if a line from point A to point B on the grid is within a range of directions between 111.8 degrees (a little south of east) and 158.2 (a little east of south). Those are approximations; the 111.8 is 90 degrees plus the arctangent of 2/5, and 158.2 is 180 minus that value. I worked out a series of calculations worthy of a medieval astronomer, but I suspect there is a simpler way. I'm going to have to do this for a variety of other vectors, and I'd like to generalize

View 4 Replies

Construct An Icon Setting Point By Point

Feb 20, 2010

I know how I can construct an icon setting point by point, but that isn't what I want. I want to use a bitmap file or a jpeg -is easy to convert an jpeg to an bitmap- and built an icon that looks like this picture.

View 2 Replies

Draw Arc From Start Point, End Point And Radius?

Jan 17, 2009

I want to make a drawing application which needs a few drawing functions I cant handle myself as im not very mathematicly inclined The first on the list of functions is to create an arc from a start point, end point and radius. The method signature is as followes.

Function CreateArc(byval StartPoint as PointF, EndPoint as PointF, Raduis as single) As PointF()
'Code to create an array of points...

[Code]....

View 1 Replies

Add A New Floating Rectangle With An Image?

Mar 16, 2012

i want to add a new floating rectangle with an image inside it to my form when i click on a button control and then use a timer control to move it in a straight line across the Form. the problems I'm having are:

1) Drawing and filling the RectangleF on the screen.

2) Animating/moving it from X1,Y1 to X2,Y2

3) Triggering the Drawing and movement with a Button Control

View 6 Replies

Getting The Floating Function Keys?

Jan 10, 2010

I use IrfanView for screen capture.After activating it (making it ready) it is necessary to use Ctrl & F11 to invoke the actual screen capture selector.how I may achieve a "Floating Key" which would act in the same way as the Ctrl & F11 combination?

View 4 Replies

Forms :: Make A Floating Toolbar

Jan 7, 2010

How can I make a floating toolbar (like the font toolbar that appears when highlighting text in Word 2007)?

I would like it to appear at a given point when mouse is clicked.

View 2 Replies

Make Floating Mini Toolbar?

Jan 7, 2010

How can I make a floating toolbar (like the font toolbar that appears when highlighting text in Word 2007)?

I would like it to appear at a given point when mouse is clicked.

View 9 Replies

Read 6 Bytes Floating From A File

Mar 5, 2011

I have an old fashion Database with several random access files and I need to import the data to a new Sql Server dababase the data. There are tables with 6 Bytes floating numbers fields and we have no Number data type with that length in VB. I tried and tried and... and can't find. I found this code in the ERP folder, is AlphaBasic. It use an envoirement namend A-shell from Microsabio .

[Code]...

View 1 Replies

If Statements Inside If Statements?

Mar 14, 2012

I am trying to figure out how to do this:

if (phrase = hello) then
"say hello"
if (phrase = how are you?) then

[CODE]...

So basically, I want it to work like a timeline. If I say hello, then it will respond and move onto the next if statement. Get it?

Here is the code I have now:

If phrase.Result.Text = "hello" Then

synth.Speak("Hello to you too")

If phrase.Result.Text.Contains("How are you") Then

[CODE]...

View 21 Replies

Implementing Floating Toolbar In Desktop Form?

Mar 30, 2009

How to implement a floating toolbar in the desktop form that can be placed anywhere in the form and also tell me if this can be called by other form other than actual form implementing it to display to the user for some common purpose.

View 5 Replies







Copyrights 2005-15 www.BigResource.com, All rights reserved