Changes

Jump to: navigation, search

Observability Project

1,741 bytes added, 23 April
m
Previous Progress
==Latest Progress==
* 24-Apr-2024: Learn about and setting up DNS etc. to link my new domain dirks.nz
* 23-Apr-2024: Setup Node.js container in Cloudlets to fetch and run head from main branch of repo below. If it's running you can access it [https://vid-nodejs-in-the-cloud.mel.cloudlets.com.au/ here]
* 22-Apr-2024: Setup basic Express.js project in new [https://github.com/VincentDirks/node.js-in-the-cloud github repo]
 
Old items are moved to [[#Progress| Progress]]
 
==Introduction==
This is a personal development project to observe this web site (https://dirksonline.net/cvwiki). I will be striving to monitor reliability, functionality, and importantly who and how it's being used.
==Background==
Users are almost always at the pinnacle of people that matter, having good models of the types of users, and what they choose to do, is critical to the success of most projects and products.
In order I want to learn about the people who use my CVWiki web site, so I am 'm going to develop some observability solutions, and in the process deepen my knowledge and experience in the technologies used in observing web sites.
I am a keen agilist, and will aim to ''maximize the work not done''. Implementing only minimalist solutions, that require the least amount of work from me, for my current context. I will favour resources I already have at hand, and the technologies I already know about. But that said, there are some large gaps I need to cover and there will be plenty new to discover and learn, I expect that some decisions may need review down the track when as I discover better technologies for my solutions.
==Architecture==
* Modular, using microservices style architecture, with various the parts of the system running in containers
* Reverse proxy in front of my current CV Wiki and to capture the traffic.
* Log aggregator & event analyserto hold the data and start analysing it
==Technologies==
===Hosting Platform===
* [https://vpsblocks.com.au/ vpsblocks.com.au]
and the associated PaaS
# Kubernetes
===Data Collection & Analysis Platform==*[https://www.splunk.com/ splunk]I have used this platform for a number of my past employers and projects and really like it. I recognise it isn't a free, nor an open source solution such as Grafana, Prometheus, ELK, Graylog etc. but it's what I know currently and will favour it until I have time and need for a better fitting solution.  I will be using the [https://github.com/Splunk/docker-Splunk docker-splunk] single containerized instance of Splunk Enterprise, with the free license.  The free license removes the auth parts and gives everyone admin access, I will investigate restricting access to it later. ==Programming Language==* Javascript* Node.js* npm* Express.jsI have better knowledge, skills, experience using these than other languages and libraries. I recognise that there may be better solutions but I will favour these for now because it feels more comfortable. Given that I'll be using containerized solutions, it should be easy to try other languages later. ===Code Quality & Inspection Tools===I would like to set these up, but haven't as yet. ==Development Environment==*VS Code* VS Code Extensions: TBD =Progress=Old items from [[#Latest Progress| Latest Progress]] will be moved to here

Navigation menu