Observability Project - Revision history

DirksWikiAdmin: /* Latest Progress */

2024-05-23T00:45:46Z

Latest Progress

← Older revision		Revision as of 00:45, 23 May 2024
Line 1:		Line 1:
	==Latest Progress==		==Latest Progress==
	* 30-Apr-2024: Configuring cloudlet to use hidden password, start automatically from service daemon, automatically refresh my [https://github.com/VincentDirks/SplunkDockerCompose.git SplunkDockerCompose] repo, and keep service file during redeploys.		* 30-Apr-2024: Configuring cloudlet to use hidden password, start automatically from service daemon, automatically refresh the local clone [https://github.com/VincentDirks/SplunkDockerCompose.git SplunkDockerCompose] repo, and keep service file during redeploys.
	* 29-Apr-2024: Setting up Splunk to run in cloudlets. Tried running Splunk image directly, but found that a docker-compose.yml file was a bit easier. At this stage I am able to run the Splunk image. I found that the cloudlets were not executing the docker compose up command, and I created a systemd daemon service for docker compose.		* 29-Apr-2024: Setting up Splunk to run in cloudlets. Tried running Splunk image directly, but found that a docker-compose.yml file was a bit easier. At this stage I am able to run the Splunk image. I found that the cloudlets were not executing the docker compose up command, and I created a systemd daemon service for docker compose.
	* 24-Apr-2024: Learn about and setting up DNS etc. to link my new domain dirks.nz		* 24-Apr-2024: Learn about and setting up DNS etc. to link my new domain dirks.nz

DirksWikiAdmin: /* Language (javascript), Runtime (Node.js), Framework (Express) */

2024-05-22T21:38:43Z

Language (javascript), Runtime (Node.js), Framework (Express)

← Older revision		Revision as of 21:38, 22 May 2024
Line 87:		Line 87:
	The free license removes the auth parts and gives everyone admin access, I will investigate restricting access to it later.		The free license removes the auth parts and gives everyone admin access, I will investigate restricting access to it later.

	==Language (~~javascript~~), Runtime (Node.js), Framework (Express)==		==Language (JavaScript), Runtime (Node.js), Framework (Express)==
	For now, I have better knowledge, skills, experience using these than others. I recognise that there may well be better solutions out there, but for now I will favour these because it feels more comfortable.		For now, I have better knowledge, skills, experience using these than others. I recognise that there may well be better solutions out there, but for now I will favour these because it feels more comfortable.

DirksWikiAdmin: /* Current Implementation */

2024-04-30T04:25:09Z

Current Implementation

← Older revision		Revision as of 04:25, 30 April 2024
Line 42:		Line 42:

	=Current Implementation=		=Current Implementation=
			==Express Demo Running in Cloudlets==
			This step's objectives were to
			# Standup a cloudlet node using an inbuilt Node.JS image
			# Link it to my code repo [https://github.com/VincentDirks/node.js-in-the-cloud.git node.js-in-the-cloud]
			# Access it from a subdomain of dirks.nz
			# Implement encryption (https)
			# Redirect calls to http to https, as well as any calls direct to the environment

			The solution is accessible at https://nodejs-in-the-cloud.dirks.nz/

			My code repo is [https://github.com/VincentDirks/node.js-in-the-cloud.git node.js-in-the-cloud]

			A Git repo is added to the cloudlets Deployment Manager, deployed it to the Node.js container, with settings to monitor the repo for changes, so that the updates are fetched and container restarted automatically.

			Created an nginx node to configure encryption and redirects

			Using the cloudlets Let's Encrypt Free SSL addon to generate certs

			fetch the changed nginx conf files and add to repo and update readme there to reflect

			TBD

	=Technologies=		=Technologies=

DirksWikiAdmin: /* Technologies */

2024-04-29T22:01:42Z

Technologies

← Older revision		Revision as of 22:01, 29 April 2024
Line 40:		Line 40:
	# Run the above suite in cloudlet and record results to splunk		# Run the above suite in cloudlet and record results to splunk
	# Schedule the above cloudlet to run daily		# Schedule the above cloudlet to run daily

			=Current Implementation=

	=Technologies=		=Technologies=

DirksWikiAdmin: /* Plan/Backlog */

2024-04-29T22:00:05Z

Plan/Backlog

← Older revision		Revision as of 22:00, 29 April 2024
Line 26:		Line 26:

	==Plan/Backlog==		==Plan/Backlog==
	# Run a basic Express.js demo in a cloudlet node with a recent Node.js image [DONE]		# <s>Run a basic Express.js demo in a cloudlet node with a recent Node.js image</s> [DONE]
	# Implement access to it from my new `dirks.nz` domain, using encryption (https) [DONE]		# <s>Implement access to it from my new `dirks.nz` domain, using encryption (https)</s> [DONE]
	# Run Splunk in cloudlets [In progress]		# Run Splunk in cloudlets '''[In progress]'''
	# Implement a reverse proxy using library from npm (for traffic to/from above Express.js demo)		# Implement a reverse proxy using library from npm (for traffic to/from above Express.js demo)
	# Create Splunk HEC (Http Event Collector) (check if config persists through redeploys)		# Create Splunk HEC (Http Event Collector) (check if config persists through redeploys)

DirksWikiAdmin: /* Architecture */

2024-04-29T21:55:56Z

Architecture

@@ Line 24: / Line 24: @@
 * Reverse proxy in front of my current CV Wiki and to capture the traffic.
 * Log aggregator & event analyser to hold the data and start analysing it
 =Technologies=

DirksWikiAdmin: /* Technologies */

2024-04-29T21:13:29Z

Technologies

← Older revision		Revision as of 21:13, 29 April 2024
Line 48:		Line 48:
	The free license removes the auth parts and gives everyone admin access, I will investigate restricting access to it later.		The free license removes the auth parts and gives everyone admin access, I will investigate restricting access to it later.

	==Language (javascript)==		==Language (javascript), Runtime (Node.js), Framework (Express)==
	==Runtime (Node.js)==		For now, I have better knowledge, skills, experience using these than others. I recognise that there may well be better solutions out there, but for now I will favour these because it feels more comfortable.
	==Framework (Express)==

	~~For the language, runtime~~, and ~~framework I have better knowledge, skills, experience using these than others. I recognise that there may be better solutions but I will favour these for now because it feels more comfortable.~~		That said though, and given that I'll be using containerized solutions, it should be easy to try other options later.

	~~However,~~ given that I'll be using containerized solutions, it should be easy to try other ~~languages~~ later.

	===Code Quality & Inspection Tools===		===Code Quality & Inspection Tools===

DirksWikiAdmin: /* Latest Progress */

2024-04-29T21:09:14Z

Latest Progress

← Older revision		Revision as of 21:09, 29 April 2024
Line 1:		Line 1:
	==Latest Progress==		==Latest Progress==
			* 30-Apr-2024: Configuring cloudlet to use hidden password, start automatically from service daemon, automatically refresh my [https://github.com/VincentDirks/SplunkDockerCompose.git SplunkDockerCompose] repo, and keep service file during redeploys.
	* 29-Apr-2024: Setting up Splunk to run in cloudlets. Tried running Splunk image directly, but found that a docker-compose.yml file was a bit easier. At this stage I am able to run the Splunk image. I found that the cloudlets were not executing the docker compose up command, and I created a systemd daemon service for docker compose.		* 29-Apr-2024: Setting up Splunk to run in cloudlets. Tried running Splunk image directly, but found that a docker-compose.yml file was a bit easier. At this stage I am able to run the Splunk image. I found that the cloudlets were not executing the docker compose up command, and I created a systemd daemon service for docker compose.
	* 24-Apr-2024: Learn about and setting up DNS etc. to link my new domain dirks.nz		* 24-Apr-2024: Learn about and setting up DNS etc. to link my new domain dirks.nz

DirksWikiAdmin: /* Latest Progress */

2024-04-29T05:01:17Z

Latest Progress

← Older revision		Revision as of 05:01, 29 April 2024
Line 1:		Line 1:
	==Latest Progress==		==Latest Progress==
			* 29-Apr-2024: Setting up Splunk to run in cloudlets. Tried running Splunk image directly, but found that a docker-compose.yml file was a bit easier. At this stage I am able to run the Splunk image. I found that the cloudlets were not executing the docker compose up command, and I created a systemd daemon service for docker compose.
	* 24-Apr-2024: Learn about and setting up DNS etc. to link my new domain dirks.nz		* 24-Apr-2024: Learn about and setting up DNS etc. to link my new domain dirks.nz
	* 23-Apr-2024: Setup Node.js container in Cloudlets to fetch and run head from main branch of repo below. If it's running you can access it [https://vid-nodejs-in-the-cloud.mel.cloudlets.com.au/ here]		* 23-Apr-2024: Setup Node.js container in Cloudlets to fetch and run head from main branch of repo below. If it's running you can access it [https://vid-nodejs-in-the-cloud.mel.cloudlets.com.au/ here]

DirksWikiAdmin: /* Development Environment */

2024-04-24T00:34:28Z

Development Environment

← Older revision		Revision as of 00:34, 24 April 2024
Line 57:		Line 57:
	I would like to set these up, but haven't as yet.		I would like to set these up, but haven't as yet.

	==Development Environment==		==Development Environment (VS Code)==
	* VS Code		* VS Code
	* VS Code Extensions: TBD		* VS Code Extensions: TBD