PgCon 2020 Developer Unconference/Building Benchmarks

Note: To be saved in wiki.postgresql.org after session.

Talking points:

	1. Competitive Benchmarking
		2. Metrics
			3. Performance
				4. TPS/TPM: Transaction Rate OLTP oriented
				4. Query Execution time: e.g. BI oriented - how fast does a reporting query run
				4. Load time: BI oriented
				4. Refresh time: BI oriented
			3. Cost - is this practical with open source?
				4. Professional services
				4. Hardware - maybe just detailed hardware configuration
			3. Other metrics
		2. How to enforce fairness?
			3. Licensing
				4. GPL: recommended
				4. Artistic License: not OSI approved
			3. Neutral site for publications
			3. Other aspects/topics
	1. Open Source Benchmarking Kit
		2. Considerations
			3. Create or adapt a project that people can agree to work together on
				4. Licensing
				4. Language
				4. Postgres specific or inclusive to other open source projects?
			3. Start with a simple workload
				4. Easy to run
				4. Easy to develop
		2. Designs
			3. BI
				4. Schema Design & Data Generation
				4. Queries
			3. OLTP
				4. Schema Design & Data Generation
				4. Transaction Definitions
				4. Workload Profile
				4. Transaction manager: build vs use existing
				4. Driver: how to build
			3. Others?
	1. Stay in touch?
		2. Mailing list