We are continuing our testing, and today we moved onto the invoices portion of the PBooks application. The basic test I ran using the selenium IDE passed without any problems, it also passed when I added the test to the test suite in the core. So right off the bat, there don’t seem to be any major bugs.
I later submitted a few forms manually and picked up on a few issues Selenium wasn’t able to recognize. I discovered that if you input the date manually rather than using the date selection tool, it will not log your entry. Even if you use the same date format it still does not seem to work properly.
Also, after you submit a new form the client name does not display where it should.
There is no way to edit your submission from the main invoices page.
Today I designed some tests with the Selenium IDE and then uploaded the tests onto the server to run using the core. The IDE only works in Firefox, while the Selenium core actually runs off of the page. This is useful because you can see how test results vary within different browsers. For example, I have found that just because something functions in Internet Explorer does not necessarily mean it will behave the same way in another browser. While manually running the tests I did not seem to run into any problems. I was able to add and delete new groups without any errors. The delete and edit buttons are working correctly.
The one issue I noticed was the fact that the organize account groups button is not working at the moment. I unfortunately had issues running the tests on the Selenium Core. Like I said, the manual run through went fine without any problems other than the organize button. Overall PBooks seems to be coming right along. We are working hard to iron out all of the bugs.
We’re working hard trying to test Pbooks and sort out the bugs. These are the results from some of the recent testing we have been doing.
10/2/07 PBOOKS TESTING
MANUAL TESTING
1. GENERAL LEDGER
The default date is set to 1970, shouldn’t the date change according to the current day.
If the date is typed in wrong, or their are no entries to be found, should a message notify the user.
Journal entries do not show up after submitting query. (real bug, needs to be filed)
2. ACCOUNT GROUPS
After submitting a new account group it doesn’t show up on the account groups main page. (this is real bug, we’ll file it.)
Unable to add sub groups to a parent grup
Not sure if the organize account groups button works or not because the groups are not displaying - (this doesn’t work yet.)
3. GENERAL JOURNAL
Journal entries do no show up after submitting query. - (this is a real bug)
4. Reconcilliation
Empty Page
5. INVOICES
Edit buttons don’t work
6. COMPANY
After entering the company info, I am not sure if the listing is stored anywhere or not. I was unable to locate the entry. - (It should display the
same information in the form again - check www.livedemo.pbooks.org
===================================================
Selenium Automated Test Results
PBOOKS TEST SUITE 1
The following tests need to be fixed to work with the current version of pbooks.
Business Account Balances
Business Account Balances 2 (Removed matchers field, option with label savings account not found)
Setup Help (Element link=PBooks Homepage -> not found)
Setup Preferences (Element display_num_entries not found)
Quicklinks New Account (Element Name Not Found)
I did some more testing today without relying too heavily on the Selenium IDE. I instead focused on errors and discrepancies that Selenium might not pick up on. These were my results.
General Ledger - The General Ledger shows some inconsistencies when it comes to changing the date span. Sometimes it will allow you to type in the date, other times you must choose a date from the calendar. Also, when you’re typing in a date it must be in a specific format(2007-02-18) or else it will not find any journal entries.
Chart Of Accounts - If the account number starts with a letter you get the following error. Exception Trace violationnew_account. The listing will now display any words that you place in the account number box.
General Journal - The debit/credit amount does not accept commas. For example the program automatically changes $40,000 to $40. The journal does not display letters if you type them into the credit/debit fields. Also the date must be a specific format or the entry doesn’t show.
We designed a test suite to test different aspects and functions of pbooks. Everything ran smoothly without problems until Selenium attempted to run the Accounts Test. The test failed because when it tries to click the test account link, the following error occurs. Element link=Test Account not found
I later discovered that the error occurred because the name Test Account was already taken, therefore, it will not allow you to use the same name.
While testing the setup preferences page I ran into the following error Element display_num_Entrie not found. I solved the problem by changing the entry number to zero. The page runs into an error because there aren’t any entries in the database.
I tried running the Selenium core with a variety of browsers to see how the test performance differed. All of these tests will be run on a computer using Windows XP.
Firefox - Selenium did not seem to find any errors and it ran six tests and passed two commands. Zero tests or commands failed. Took 27 seconds to perform tests.
Internet Explorer - I had trouble getting the selenium core to run in IE at first, but I think that was because there was a problem logging in. However, once I took care of that issue the core managed to pass all of the pbooks test. Although, it did take a lot longer to do so in this browser. The tests finished in 1 minute 22 seconds.
Opera - The Selenium core did not have a problem running the tests with Opera and had the same results as the firefox test. Took 37 seconds to perform tests.
Netscape - Selenium was also able to perform its tests without a problem using the netscape browser. 6 tests were run and 0 failed, however, the test did not run any commands on this browser. Took 48 seconds
to complete commands.
The tests ran successfully on each of the browsers I tried, with internet explorer being the only one that gave me a little bit of trouble. The speeds of the test completion also varied, with firefox being the fastest and IE being the slowest.
Latest Comments
RSS