The lists below give you a idea of what I’m working on. I tend to announce significant news on Blot’s Twitter account. Please don’t hesitate to contact me if you have any questions.
Done

Added method to resolve relative URLs in feeds
7 days ago

Improved template build script
7 days ago

Updated script to resolve urs
7 days ago

Improved local client
8 days ago

Added load script for debug
9 days ago

Fixed bug in template build script
9 days ago

Added method to resolve relative links. Useful for RSS feeds etc.
9 days ago

Added script to randomize post dates for design purposes
9 days ago

Fixed bug in webloc converter
11 days ago

Updated homepage title
11 days ago

Tweaked domain page copy
13 days ago

Removed border under empty directory message
13 days ago

Fixed straight quote
13 days ago

Fixed remove photo button
13 days ago

Tweaked theme page and services page
13 days ago

Fixed create blog title page
13 days ago

Merge
13 days ago

Added simple queue to local test client
14 days ago

Fixed bug archiving removed templated
14 days ago

Updated archive script
14 days ago

Print proper id for templates to remove
14 days ago

Print error message to view
14 days ago

Tweaked logging
14 days ago

Added silent flag
14 days ago

Improved logging in script
14 days ago

Added silent option
14 days ago

Added section to catch removed templates
14 days ago

Initial commit
14 days ago

Fixed folder bugs
15 days ago

More tuning
22 days ago

Normalized font size for header elements
22 days ago

Added Charter font
23 days ago

Tweaked dashboard wrapper padding:
23 days ago

Added fade to link hover
23 days ago

Polished dropdown
23 days ago

Improve dropdown
23 days ago

Tweaks to dropdown
23 days ago

Tweaked client page layout
23 days ago

Updated list of sample sites for the templates
24 days ago

Added SIL licensed fonts
24 days ago

Initial commit
24 days ago

Enable debug on ci logs
24 days ago

Re-enabled rest of test suite
24 days ago

Removed seed flag from Travis
24 days ago

Prevent travis running multiple builds
24 days ago

Fetch seed from env if none is passed to cli
24 days ago

Added seed to travis config
24 days ago

Zero in on failing test
24 days ago

Improved logging
24 days ago

Refactored middleware for Dropbox authentication
24 days ago

Added logging
25 days ago

Added script to list contents of dropfolder folder
25 days ago

Added scripts to list and copy templates between blogs
25 days ago

Added old dropdown
a month ago

Fixed footer links
a month ago

Fixed more issues with dropdown
a month ago

Fixed sidebar with no avatar
a month ago

More settings re-arrangement
a month ago

Added main tag
a month ago

Added description tag
a month ago

Added alt tag to play button
a month ago

Resolved duplicated IDs on homepage
a month ago

Added noreferrer and noopener to links on homepage
a month ago

Gzip static javascript
a month ago

Added new color picker support for console theme
a month ago

Open color picker for text and link colors too
a month ago

Archived other templates
a month ago

Archived mono template
a month ago

Archived blank template
a month ago

Amended script to track template popularity
a month ago

Amended script to track template popularity
a month ago

Added script to track template popularity
a month ago

To do

Fix links in daily update email

Template system

  • Fix bug with template editor which resets content of a view. Follow up with Nathan who has extensive steps to reproduce, and John
  • Ask to confirm, but remove files from blog folder when disabling local editing
  • Move to uuid based template IDs instead of slug
  • Add support for 'creating' a template inside '/Templates/'
  • Add export to zip and import to zip feature for themes
  • Fix bug with theme editor which prevents you from setting the route of a new view. You need to set it, then reset it for the route to work as expected.
  • Allow paginated list of entries on other pages and tell Kevin
  • Fix bug with title and partials in local editing then tell Luke and Frank
  • Fix bug with cache not busting for static rendered themes:
    1. put posts in blog
    2. sync, create view e.g. static.js which renders all_entries
    3. remove posts from blog
    4. reload page, static.js still shows the entries, which archives.html does not
  • Read and write package.json for local editing, then tell Aurynn and Brian know when it's possible to set variables locally

Template spec

  • all themes must support a 'landing page' modification nicely
  • feed, archive, essays, portfolio, magazine must be optimized for code
  • all themes must be colorblind, with goal to add a color customization layer
  • Don't think about Blot developers in any way, produce seperate simple templates for them

Template selection

Find good source of material, ideally on Blot like this source for theme content

Investigate Jekyll themes to use which have permissive licenses

Tell Chris, Nash and John know about new themes

Increase price for new customers to $30 a year. This will not affect existing customers.


Fix bugs with git removed / renamed file unit test on Travis

Determine cause of Markdown converter failure for Dropbox/Apps/Strange encoding bug

Fix John's thumbnail bug

Fix bug which occurs when you change your username while using the Git client (repo url breaks) and tell Koen

Fix bug which means that a date specified in a file's path takes precedence over a date specified in the file's metadata. Current behaviour conflicts with the documentation. Tell Sean

Fix display of first item on magazine them when it lacks a thumbnail. Tell Chad

Fix Anders image path bug. A file titled "_på besøg hos gomorgen danmark.jpg" cannot be embedded in a blog post. Write test which ensures this doesn't happen again. This should also fix bug with case-sensitive paths to thumbnails + Dropbox client and tell Jan-Erik on Twitter DMs. Make resolve work more impressively, attempt to resolve a path in a case insensitive manner. Or is this a good idea? Maybe we should only resolve paths which match stored metadata? Or should we make a best-effort? As long as we are resolving case-only it should be fine... Tell Michael it now works. This should also fix bug with accents in image paths for Wesley. Incorporate retries into the thumbnail fetcher...

Fix bug with automatic title generator which removes the datestring from files whose name is only a datestring. Tell Andrew

Fix Kevin's URL encoding bug. Each entry's url property is not encoded as a URI component on the server but it needs to be.

Work out elegant way to produce fully qualified SRCs and HREFs for blogs to help make RSS feeds work more effectively, then tell Jack, Sven, Kevin and Will about the fix, which affects people who use micro.blog. Also tell Michael who is hardcoding his domain. Also tell Jaco

Import John's posts from flickr

Markdown bugs

  • Fix bug with .emf files in Word Document and follow up with Todd. Can we convert EMFs? Can we pass a flag to pandoc to let them deal with it? Is this just caused by Tiff files? I need a Windows machine to test this.

  • Fix bug with double escaped embedded ampersands then tell Gavin and Ryan his

Fix bug with case-sensitivity when transfering from Git to Dropbox and tell Shantesh

  • Fix issue with teaser generator that locks up a build process, sometimes for 10+ seconds.

  • Fix bug with pandoc's video embed feature which automatically adds the autoplay attribute when turning a raw url to a video into a video player then tell Wesley know

  • Fix bug with blockquotes and tell Kerim. Multiple ">" symbols on the blank paragraphs between other quoted text are not formatting properly.

  • Fix bug with strange windows notepad encoding

  • Let Osvaldo know

  • Fix bug with indented code in pre tags and tell Michael

Metadata bugs

  • Fix permalink issue with periods and tell Farzain

  • Add support for YAML-style custom metadata and tell Shibel and Casey and Amit

  • Add support for IPv6 and tell Raul

  • Fix bug generating summary when title metadata is set and tell Amit

  • Fix encoding bug with greek URLs then tell Rodericus know

  • Fix bug with how the date parser. It doesn't handles a space (or lack of space) between the date and the time. For example, '2017-08-27 18:16:59' works but '2017-08-27-18:16:59' doesn't

  • Fix bug parsing ISO8601 date format and tell Thomas

  • Fix bug in metadata parser which gets tripped by a URL on the first line of the file then tell Jan, Pete and Kim know

  • Fix bug with case sensitivity for tag folders. Need to recursively check all directories for proper case when extracting tags then tell Thomas

Prevent ignored files from generating preview.html files when inside the Drafts folder. Tell Kerim


Record a new demo video

  • Show sites I run using Blot
  • "Bring your own interface"
    • show demo of simple custom text editor built in electron or something which has autocomplete tags, drag and drop images, explain that you can build something like this yourself.
  • Blot's developer blog, a conventional blog, show using different text editors
  • My visual scrapbook: shows tag folders, photo blog
  • My link blog: shows the webloc feature, shows IFFFT, perhaps from favourited tweets?
  • My personal site: simple landing page, edit with a doc file?

Work out how to host podcasts on Blot and tell Adrian

Move to using unix socket with redis client per documentation for better throughput. Read this issue first, I might need to make some user group permissions tweaks to ensure things are secure.

Seperate blog subscriptions behind the scenes to avoid the crazy calculations. Think of them like domains, you wouldn't do what Blot is doing for those...

Increase default quality for sharp's output images

Client.write does not propogate sync errors... to demonstrate this, revoke dropbox token then try to enable local editing.

Re-enable image minifier and fix the bugs it creates

Can we keep the pandoc child_process running and pipe stuff in and out for speed? Measure before after to ensure this helps

Generate screenshots as thumbnails for webloc posts perhaps using pupeteer and PNG8, which seems efficient for screenshots

Move to Linode

Prune package.json

Cluster the main process. How will I verify that there is not statefullness somewhere in the server? I also want the main 'server' running on different threads to the CPU intensive stuff like image processing. Will this fix the bug with additional child processes if main process runs out of memory? Something wasn't being killed during the Nash WAV bug of August, 2018. There were duplicate node rebuild processes running.

Add support for Microformats in the default themes. Tell Amit.

Add support for Micropub in Blot's API. Tell Amit.

Add support for HTTPS on preview subdomains

Distribute static built blogs on dat or something similar

Ensure the nginx service can be controlled properly using Upstart. It seems like Monit's attempts to reboot the service which failed, caused the downtime. Potentially worth reviewing commands in this: https://gist.github.com/andmej/1953239

Add an EXPIRY to the log entries for a blog's 404 log

Use a redis analysis tool to see if I can squeeze more out of REDIS

Set up Dependabot to automate dependency upgrade PRs

Make dashboard requests idempotent to prevent multiple form resubmits, multiple new blogs created accidentally? More information about idempotent requests

Follow up with Christian about DataValet blocking

Work out why Pandoc cannot handle 'linked' images (instead of conventionally embedded images). For instructiosn on reproducing bug, see SG's email and follow up when resolved.

Look into mirroring site across multiple domains and follow up with Thomas

Create server dashboard to visualize load etc. using something like this: https://github.com/GitSquared/edex-ui or https://github.com/yaronn/blessed-contrib

Move to cool user subdomains

  • Pretty to proper blog IDs instead of integers

Public site

  • Log 404s on the public site to identify neccessary redirects
  • Personalize the documentation for logged in users
  • Add a resource page to the documentation with guides like Chad's And useful text editors like this one recommended by Andrew
  • Inline all CSS for performance
  • Render the formatting guide navigation on the server

Developer documentation

  • Make reference page searchable
  • Add types and examples to items on reference page
  • Work how to explain the archives property

Self-hosting documentation then tell Jake and Mohammed

Investigate static site search offerings

  • It would be nice to have one whose index you could build on the server, and deliver statically, perhaps even chunked if it was huge
  • Would be nice to be able to patch updates to this index quickly without rebuilding the whole thing

Template

  • Add support for 'Template' folder and a way to copy this to dashboard?

  • How do we share info, like a link on a menu, or a header image across themes? Could there be a shared info repository that themes could access?

  • add support for dynamic partials to make collections possible, e.g. {{> /{tag}.html}} ?

  • Add neat interface to customize blog level variables?

  • How do we transition from a global menu to one that the themes have control over? How do we share existing links between themes? How do we deal with the order of pages in a user's folder?

  • How do we transition from a global date display format to one that themes have control over?

  • Change url?json=true to debug=true?

  • Port the jekyll theme Neocactus to Blot and document the process then tell Robert

  • Finish Ghost theme import for Kingi

  • Draw simple abstract representations of each theme for the themes page to replace thumbnails
  • Install and test a few of these static site generators
  • Make themes file or folder based
  • Consider making file-based theme directory a git repo and using this to implement basic undo-redo functionality.
  • Disable re-rendering for locals
  • Add better customization options
  • Local theme editing does not clear cache
  • Use Hogan for precompiling and rendering themes?
  • Parse tokens and params from routes and tell Jason
  • Add way to allow all entry lists to access {{#months}} sorting options just like the archives page.
  • Fix Frank's strange theme bug
  • Warn users that underscore will not work for hidden pages
  • Fix _ entries to true public files, tell john & other folks who depend on the menu: yes, page: no side effect
  • Tell Rodrigo don't write previews for _ posts
  • Add support for fetching only some properties of an entry (ideally only those that are used). prevent some properties from being fetched in some lists (html, for example in all_entries). Would be a good candidate for hgetall or hget?

Dashboard

  • Offering a broken link checker service
  • Dumb quotes are still smartified, even without typeset enabled.
  • Tolerate missing 'www' in personal domain field on dashboard for users with a custom domain when checking validity
  • Can we trim the homepage to get to this? Title , Domain, Theme , Photo , URLs , Dates. Menu, Dates, Disqus, Analytics etc. would be customized per theme Services page would be phased out, perhaps introducing metadata flags, e.g. Typeset: no Katex: no Or global flags in something like config.json. Would be rare though. Client would be a link at the bottom corner of the folder. Synced by Dropbox (edit)

  • Generate SSL cert for www subdomain of apex domain pointed to Blot, and redirect it to apex domain. Tell Paul

  • Implement a flags page for toggling all the settings (including hidden ones) for a given blog

  • Route requests to new dashboard if toggle is on to allow thorough testing
  • When a user pastes the whole tracking script into the preferences page on the dashboard, strip out everything except the ID which we need... perhaps create a page explaining what is happening before doing this.
  • Handle noscript on dashboard / signup gracefully (remove all dashboard js?)
  • Allow users who are restarting an account with multiple blogs to disable some before restarting.
  • Take a look at Notion and Cargo for some neat ideas
  • Disabling a blog should free up the domain and handle associated
  • Removing a domain from a blog does NOT delete the domain:example.com key from redis. meaning if a user sets a domain once, it's effectively theirs forever. This is a bug!

File converters / codecs

  • Video posts (.mp4)
  • OPML files and tell John
  • Audio posts (.mp3 for now?) and tell Kevin
  • Multi-file posts from inside one folder? 'Folder>' Tell Kevin, Nash and Roberto
  • Multi-file posts with the same name but different extension (image.txt and image.jpg)
  • Markdown Write a pandoc compatible markdown converter in javascript to resolve some of the performance issues with pandoc. Perhaps just use Markdown-it
  • Add support for checkboxes and tell Matt and Shridhar

  • Add support for Pelican-style metadata in HTML posts using

  • Expose exif data on Photo posts? See if you can add comments to image metadata and tell Riley, also tell Mike

Write a importer tool which scrapes and imports content from any blog/website

  • Map excerpt metadata to summary for Jekyll converter importer
  • Look into how Hexo has written imports for blogger, joomla, rss, wordpress.

Internationalize i8n

Allow Blot to fallback to client.read if the file does not exist on the blot server. Say the harddrive is wiped, we still would like to serve blog files

Sync

  • Re-implement folder verification feature and make use of the local content hash computation script to verify we have the correct version of a given file
  • Make the sync / rebuild proceses run with unpriviledged user permissions to ensure shit isnt fucked with user input... – Re-instate feature to check if a rogue sync took down the server and run sync on a seperate process
  • Add method to pause syncing and prevent future syncs then use this method with the create/remove blog migration too.
  • Ensure sync script is run by less priveledged user (just access to /tmp ? /blogs/{{ID}})?

Increase price for new customers to $40 a year. This will not affect existing customers.


Buy the .com

  • Remember to bump LetsEncrypt rate limits if needed
  • Remember to transfer Dropbox webhooks to new domain on the Dropbox developers console

Incorporate

Add support for other payment methods

  • Bitcoin and tell Chaz

Start monthly newsletter with improvements, changes

Support embedding an image in a post by copy-pasting the Dropbox share link

Increase price for new customers to $60 a year. This will not affect existing customers.


Git client:

  • Backdate existing commits (perhaps set file ctime using info from git log?) This would sidestep the frustration experienced by Gavin when he imported an existing repository.
  • Extend sync lock during long syncs
  • Write test to simulate process dying and restarting mid-pull. Does the client recover? What happens if a pull fails midway? Does git recover?
  • Write tests for a series of random client operations (pull, add, push, move, reset, delete) that can be seeded and reliably re-run in the case of failure.
  • Move to neat promise chain api when 2.0 comes out
  • Test that client must keep sending new entries and deleted entries when it recieved an error from entry.build otherwise you get ghost posts...
  • send nice error message with instructions for 413 request too large: "git reset HEAD^" etc...
  • Thoroughly document:
    • write
    • read
    • sync
  • Tidy up tests and reduce size and runtime
  • Add documentation and an explanation for how to mirror blot blog repo on Github or Gitlab: https://mail.google.com/mail/u/1/#inbox/1658e28be94479af
  • This client should acquire a lock on the blog's folder before doing stuff to it more generally, especially during initialization etc...
  • what happens if user changes their handle? will pushing break?
    • I want them to be able to keep using their old one until someone else claims it, then I want 401 unauthorized, please reauthenticate with new username... but the remote path will be wrong?
  • Rate limit authentication route?

Dropbox client:

  • Adding an additional blog to existing app folder under constant webhooks failed. New blog had correct folder but old blog still used root. I guess we need to acquire a lock on ALL blogs interacting with that dropbox account.
  • Extend sync lock during long syncs
  • Write test to simulate process dying and restarting mid-pull. Does the client recover?
  • Write tests for a series of random dropbox client operations (pull, add, push, move, reset, delete) that can be seeded and reliably re-run in the case of failure.
  • Look into getAccessTokenFromCode on DBSDK repo to avoid the mess in get_account.js https://github.com/dropbox/dropbox-sdk-js/issues/64
  • Gracefuly retry wrapper around Dropbox
  • Can we write to a folder_id instead of a path? It would be nice to be able to move the blog's folder even when writing the initial files to it, for example...
  • This should be simple once we copy the exisiting state of the blog folder across. But right now it doesn't really do much. It resets the local server folder. Then resyncs.
  • Update to latest version of Dropbox client.
  • Make the folder in Dropbox rename automatically when the user changes the username for one of their multiple blogs?

Support 2FA (Two factor authentication)

Consider supporting Open Graph

Add support for entry property with escaped double quotes, tell Jay

NGINX

  • Improve error pages
  • Recompile nginx with neccessary dependencies for auto-ssl instead of openresty
  • Install nginx fail2ban & http2

Support linking to another blog post by its file path

Generative tree

  • Add a generative tree illustration to account page that is 'seeded' when you sign up and grows as you keep your account open. Slowly, day by day. Would still be growing in 1000 years should your account stay open that long.
  • Learn about old trees
  • Learn how to make a generative illustration and render it quickly on the server
  • I like this idea because it's sort of anti-Farmville (i.e. click-to-grow, engage-to-grow). The tree just grows. No badgering to post more to keep the tree alive, all you have to do is keep your account. When you delete your account you just see the tree, and a thank you. Obviously don't do anything tacky like cut the tree down or anything. That would be horrible.
  • Could this Wave Function Collapse algorithm be useful?
  • Look into computational biology and fractals

Removing Date metadata from a post should reset its date to the file's creation date

  • Currently nothing changes.

Add support for 'time' metadata property

  • Useful for posts with path-based-dates.
  • e.g. 'Time: 4:15pm'
  • Would append to any other date associated with the post.

Download the webpage for bookmark files and try to extract title + summary

Add a file dependency / dependents list to each entry then use this to rebuild dependent entries when, for example, a public image is updated.

Add support for comments via webmentions

Thumbnail generator

  • Improve transformer so it checks a file's MTIME against a stored value before rehashing the file
  • Generate thumbnails for GIFs / SVG thum
  • Prioritize faces
  • Aim to generate distinct thumbnails across the blog
  • Try to crop out ruined borders. E.g. when making a square crop of a rectangular image with a border, crop into the image as well to remove the border-on-three-sides effect
  • Extract color palette too for the image
  • Run quickly first time, then run in the background to pick the best thumbnail
  • Offer imgix style API for embedding thumbnails

Migrate code from require('mime') to require('mime-types') since it doesn't use a global default type. Remove the mime node module.

Move off the CDN

  • Work out why blotcdn is so slow for https://latency.apex.sh
  • Backup s3 buckets every day? delete those older than a month?

Migrate code from require('../../../') to shortcuts in node_modules

Remove the dirToModule code and hard link the require references.

Use \<select> optgroup on timezone select dropdown to subdivide zones by current time, and steal the presentation format used by basecamp.

Backups

  • Add hourly local redis rdb dumps
  • Add script to roll back into hourly local db dumps and remote backups
  • Delete backups older than a month from s3 automatically

Add daemon for zero-downtime node restart

Move to pretty IDs for everything

Re-do url redirector to use route-parser and properly support regular expressions

Handle queries properly https://mail.google.com/mail/u/0/?zx=tqp989l7y4yi#inbox/15b575fbc8d80ad1

Giphy url support

Catch rename failed to find a match for scrapboox/patch_bunny_slippers.jpg -> /patch_bunny_slippers.png

Indicate that some posts' permalink will not change (if metadata) on the dashboard when setting the blog's permalink format. Tell Chet.

Can rename tolerate a minor file size change?

Add filtering by date to 404 log https://mail.google.com/mail/u/0/#inbox/1566e52d170f29ca

Move daily update generator from scripts to app folder

If entries share publish date, sort them by blot creation date

Rewrite footnote links in a teaser from #frag to {{permalink}}#frag

Add plugin for inline popover footnotes

Enable hyphenation again then tell rodericus

Investigate atompub support for Marsedit and tell Chet

Find cause of fontconfig error / warning

Password protection for blogs

Create an API for Blot

Add option to enable hard line breaks

Email

  • Install time mover library
  • add proper error handling to email
  • make it easier to pass in variables

Validator

  • check each id has an entry and each entry has an id
  • check menu is right (pages exist, non deleted etc...)
  • generate fake entries for id clash
  • must check each blog folder exists...

Move to some SQL for storing each entry's input and output...

Fix image caption plugin to be semantic

Devise nice way to declare unit tests for a file which don't need to be run on server start but can be run programmatically...

Add button to remove avatar from settings page https://mail.google.com/mail/u/0/#search/remove+avatar/14f3e02d6dcf97ac

Incorporate typographic features from textile http://redcloth.org/textile/phrase-modifiers/

queue scheduled entries in redis this makes each server less stateful

Noindex blog search results pages

Re-enable CSP on blot site in a way that works in Safari

Popular entry list

Related entry list

Expose list of rendering errors to callback

Prevent uploads will still pipe large files on the server

Add rewrite feature, e.g. rewrite /randomColor to /public/randomColor

Menu needs concurrency

Push archives feature https://mail.google.com/mail/u/0/#inbox/14fb1a48c08fe9be

Banned permalinks are possible when page:yes

Incorporate disk space monitor to alert for low space

Archive logfiles with backups

Generate list of external api dependencies and follow changes for each

Make drafts preview file identical (construct iframe based on window.location.href) and use copyref

Undo option for form changes

Store metadata for each file (type, size, mtime)

Add an explanation for the folder migrator...

Seperate the settings for blog and user & billing

Implement custom CSS for syntax highlight plugin

Ensure Youtube plugin still functions if apis fails

Prevent image zoom plugin from zooming emojies

Embed plugin https://github.com/ritz078/embed.js

Soundcloud embeds then tell Jonas, Nashp, and Anders

Create script to export Blot sites to common formats and let Roberto know

Add transactional emails notifying user of changes to their email or password.


Move from preview files -> webloc / .url files ?

Consider adding date format localization with Moment

Create webloc to live version for each entry?

Move from 'archives' to 'archive'?

Look into how Jekyll does data files and possibly support?

Consider adding markdown support for mermaid?

Create a comment system to replace Disqus

Create an email list system to replace Tiny Letter

Add .lhs support and tell Roy

Add support for github style checkboxes and tell Christian

Add a cool bookmarklet which drafts a post a la this demo

Consider allowing users to buy domains on Blot through DNS simple