Progress Report 2010 - Revision history

Dabbott: /* The Case */

2014-10-20T11:11:04Z

The Case

← Older revision		Revision as of 20:41, 20 October 2014
Line 18:		Line 18:
	The project is based upon attempts to revealthe identity of a middle aged man discovered dead on a metropolitan beach in South Australia in 1948. With little solid evidence of his death apart from the body itself, the man’s passing has remained a mystery covered in controversy for decades. He was found resting against a rock wall on Somerton Beach opposite a home for crippled children shortly before 6:45 am on the 1st of December in 1948. A post-mortem of the body revealed that there was no possibility that the death was natural due to severe congestion in his organs. The most likely cause of death was decided to be from poison, which in 1994 was uncovered by forensic science to be digitalis<ref name="Taman Shud Wiki">http://en.wikipedia.org/wiki/Taman_Shud_Case</ref>.		The project is based upon attempts to revealthe identity of a middle aged man discovered dead on a metropolitan beach in South Australia in 1948. With little solid evidence of his death apart from the body itself, the man’s passing has remained a mystery covered in controversy for decades. He was found resting against a rock wall on Somerton Beach opposite a home for crippled children shortly before 6:45 am on the 1st of December in 1948. A post-mortem of the body revealed that there was no possibility that the death was natural due to severe congestion in his organs. The most likely cause of death was decided to be from poison, which in 1994 was uncovered by forensic science to be digitalis<ref name="Taman Shud Wiki">http://en.wikipedia.org/wiki/Taman_Shud_Case</ref>.

	Among the man’s possessions were cigarettes, matches, a metal comb, chewing gum, a railway ticket to Henley Beach, a bus ticket and a tram ticket. A brown suitcase belonging to the man was later discovered at the Adelaide Railway Station. In it contained various articles of clothing, a screwdriver, a stencilling brush, a table knife, scissors and other such utensils. Authorities found the name “T. Keane” ~~and~~ the ~~unknown man was temporarily identified as~~ a ~~local sailor by the~~ name ~~of Tom Keane~~. ~~However, this was soon proved to be incorrect and the man’s identity has been a mystery ever since~~. The Somerton man has since been incorrectly identified as a missing stable hand, a worker on a steamship, and a Swedish man<ref name="Taman Shud Wiki"/>.		Among the man’s possessions were cigarettes, matches, a metal comb, chewing gum, a railway ticket to Henley Beach, a bus ticket and a tram ticket. A brown suitcase belonging to the man was later discovered at the Adelaide Railway Station. In it contained various articles of clothing, a screwdriver, a stencilling brush, a table knife, scissors and other such utensils. Authorities found the name “T. Keane” on some of the items, but they were unable to find a missing person with that name.. The Somerton man has since been incorrectly identified as a missing stable hand, a worker on a steamship, and a Swedish man<ref name="Taman Shud Wiki"/>.

	A spy theory also began circulating due to the circumstances of the Somerton man’s death. In 1947, The US Army’s Signal Intelligence Service, as part of Operation Venona, discovered that there had been top secret material leaked from Australia’s Department of External Affairs to the Soviet embassy in Canberra. Three months prior to the death of the Somerton man, on the 16th of August 1948, an overdose of digitalis was reported as the cause of death for US Assistant Treasury Secretary Harry Dexter White, who had been accused of Soviet espionage under Operation Venona. Due to the similar causes of their death, the rumours of the unknown man being a Soviet spy began to spread.		A spy theory also began circulating due to the circumstances of the Somerton man’s death. In 1947, The US Army’s Signal Intelligence Service, as part of Operation Venona, discovered that there had been top secret material leaked from Australia’s Department of External Affairs to the Soviet embassy in Canberra. Three months prior to the death of the Somerton man, on the 16th of August 1948, an overdose of digitalis was reported as the cause of death for US Assistant Treasury Secretary Harry Dexter White, who had been accused of Soviet espionage under Operation Venona. Due to the similar causes of their death, the rumours of the unknown man being a Soviet spy began to spread.

A1162144: /* Verification of Past Results */

2010-06-03T05:50:28Z

Verification of Past Results

← Older revision		Revision as of 15:20, 3 June 2010
Line 85:		Line 85:
	==Progress So Far==		==Progress So Far==
	===Verification of Past Results===		===Verification of Past Results===
	[[Image:randomletter.jpg\|~~400px~~\|right\|Completed Random Letter Sample form.]]		[[Image:randomletter.jpg\|thumb\|right\|Completed Random Letter Sample form.]]
	In order to decide on a direction for the use of the web crawler, it was first important to look at the previous students work and make a decision on whether their conclusions are accepted.		In order to decide on a direction for the use of the web crawler, it was first important to look at the previous students work and make a decision on whether their conclusions are accepted.

A1162144: /* Verification of Past Results */

2010-06-03T05:50:05Z

Verification of Past Results

← Older revision		Revision as of 15:20, 3 June 2010
Line 85:		Line 85:
	==Progress So Far==		==Progress So Far==
	===Verification of Past Results===		===Verification of Past Results===
	[[Image:randomletter.jpg\|~~thumb~~\|right\|Completed Random Letter Sample form.]]		[[Image:randomletter.jpg\|400px\|right\|Completed Random Letter Sample form.]]
	In order to decide on a direction for the use of the web crawler, it was first important to look at the previous students work and make a decision on whether their conclusions are accepted.		In order to decide on a direction for the use of the web crawler, it was first important to look at the previous students work and make a decision on whether their conclusions are accepted.

A1162144: /* Verification of Past Results */

2010-06-03T05:49:39Z

Verification of Past Results

← Older revision		Revision as of 15:19, 3 June 2010
Line 85:		Line 85:
	==Progress So Far==		==Progress So Far==
	===Verification of Past Results===		===Verification of Past Results===
			[[Image:randomletter.jpg\|thumb\|right\|Completed Random Letter Sample form.]]
	In order to decide on a direction for the use of the web crawler, it was first important to look at the previous students work and make a decision on whether their conclusions are accepted.		In order to decide on a direction for the use of the web crawler, it was first important to look at the previous students work and make a decision on whether their conclusions are accepted.

A1162144: /* Conclusion */

2010-06-03T03:22:23Z

Conclusion

← Older revision		Revision as of 12:52, 3 June 2010
Line 308:		Line 308:
	==Conclusion==		==Conclusion==

			Overall there has been significant progress towards achieving the aim of the project. The previous results have been accepted and there has been advancement in the areas of both web crawling and producing pattern matching algorithms. After some minor issues are overcome in both areas, it is planned to integrate the two modules of the project together. This will allow for extensive searching and result compilation for further analysis.

	==References==		==References==

A1162144: /* Web Crawling */

2010-06-03T02:46:04Z

Web Crawling

← Older revision		Revision as of 12:16, 3 June 2010
Line 189:		Line 189:
	While using Arachnid is proving to be quite useful, there have also been some issues encountered (see “Approach for Remainder of the Project” section). Because of this, other alternative crawling methods have been researched in parallel to Arachnid.		While using Arachnid is proving to be quite useful, there have also been some issues encountered (see “Approach for Remainder of the Project” section). Because of this, other alternative crawling methods have been researched in parallel to Arachnid.

	The main alternative for retrieving data from websites that is being investigated is Wget. This is a program that would be highly useful for use in the project for the following reasons:		The main alternative for retrieving data from websites that is being investigated is Wget <ref>http://www.gnu.org/software/wget/</ref>. This is a program that would be highly useful for use in the project for the following reasons:

	*Freely available		*Freely available

A1162144: /* Web Crawling */

2010-06-03T02:44:33Z

Web Crawling

← Older revision		Revision as of 12:14, 3 June 2010
Line 187:		Line 187:


	While using Arachnid is proving to be quite useful, there have also been some issues encountered (see “Approach for ~~Remaining Part~~ of the Project” section). Because of this, other alternative crawling methods have been researched in parallel to Arachnid.		While using Arachnid is proving to be quite useful, there have also been some issues encountered (see “Approach for Remainder of the Project” section). Because of this, other alternative crawling methods have been researched in parallel to Arachnid.

	The main alternative for retrieving data from websites that is being investigated is Wget. This is a program that would be highly useful for use in the project for the following reasons:		The main alternative for retrieving data from websites that is being investigated is Wget. This is a program that would be highly useful for use in the project for the following reasons:

A1162144: /* Web Crawling */

2010-06-03T02:43:56Z

Web Crawling

← Older revision		Revision as of 12:13, 3 June 2010
Line 181:		Line 181:
	*Iterate through the website and produce a list of URLs and their associated name found along with an incrementing counter		*Iterate through the website and produce a list of URLs and their associated name found along with an incrementing counter

	The screen print below shows the command lines printed out for the beginning of a search on www.adelaide.edu.au, the university website. As can be seen the results are displaying each found URL with a number and a title. The title = null lines are explained later in ~~the~~ report.		The screen print below shows the command lines printed out for the beginning of a search on www.adelaide.edu.au, the university website. As can be seen the results are displaying each found URL with a number and a title. The title = null lines are explained later in this report.

	[[Image:arachnidscreenprint.jpg\|600px\|centre]]		[[Image:arachnidscreenprint.jpg\|600px\|centre]]

A1162144: /* Web Crawling */

2010-06-03T02:42:46Z

Web Crawling

← Older revision		Revision as of 12:12, 3 June 2010
Line 160:		Line 160:

	===Web Crawling===		===Web Crawling===
	An open source Java based Web crawling device called Arachnid has currently been the main focus in terms of producing the web crawler. This crawler is so far proving to be quite useful for the project due to the following traits:		An open source Java based Web crawling device called Arachnid<ref>http://arachnid.sourceforge.net/</ref> has currently been the main focus in terms of producing the web crawler. This crawler is so far proving to be quite useful for the project due to the following traits:

A1162144: /* Verification of Past Results */

2010-06-03T02:38:58Z

Verification of Past Results

← Older revision		Revision as of 12:08, 3 June 2010
Line 104:		Line 104:


	Although the results are not identical to the previous student’s results, they are very different to the graph depicting the code from the Somerton man. This leads us to agree with the previous assumption that the code has not been produced randomly.		Although the results are not identical to the previous student’s results, they are very different to the graph depicting the code from the Somerton man. It is clear that in both results there is not 1 letter that has a frequency less than 1. This leads us to agree with the previous assumption that the code has not been produced randomly.
	So far there have not been enough samples from intoxicated subjects in order to produce a useful result. This is an ongoing collection and will be finalised when there are enough samples to compile a graph that can be considered useful.		So far there have not been enough samples from intoxicated subjects in order to produce a useful result. This is an ongoing collection and will be finalised when there are enough samples to compile a graph that can be considered useful.
	It was initially planned to use the age and sex data that has been collected to subdivide the results into different categories in order to conclude whether the letters in the Somerton man code are better correlated to a specific age group or sex. It was then realised that this will involve the collection of many more samples than is needed to verify the past students results and has therefore not been included in the results. Collecting more samples and splitting the data into different categories may provide useful results for future studies into the case.		It was initially planned to use the age and sex data that has been collected to subdivide the results into different categories in order to conclude whether the letters in the Somerton man code are better correlated to a specific age group or sex. It was then realised that this will involve the collection of many more samples than is needed to verify the past students results and has therefore not been included in the results. Collecting more samples and splitting the data into different categories may provide useful results for future studies into the case.