DAT602 – Face Login – Profile Image/Amazon S3

Amazon S3

As part of the Face Login system, I have access to a number of images of faces that were used to train the face recognition system. It would make sense to be able to display a profile image of the logged-in user using one of these photographs.

The plan is to upload all the images of users to Amazon S3, make each image publicly accessible, and then display the relevant image by linking to the image from the profile page of the Face Login system

Continue reading “DAT602 – Face Login – Profile Image/Amazon S3”

DAT602 – Face Login – Twitter Visualisations

Twitter Visualisation

I have developed a functioning face login system based on Microsoft’s Azure Face API, Node.js and Express. After users have logged in using the face recognition system, I would like them to be able to access some personalised content from their social media platforms.

The first platform I looked at was Twitter and I made use of Tolga Tezel’s Twit package (Tezel, no date).

Continue reading “DAT602 – Face Login – Twitter Visualisations”

DAT602 – Face Login and User Authentication with Node.js Passport

Face Login

In my previous post, I described the development of a web interface that used Javascript to access Microsoft’s Cognitive Services Azure Face API. This interface allowed an image of a face to be captured via a web-cam and identified against a previously trained Person Group.

Now that this basic system is functioning as expected, I can use it as the basis for a Node.js/Express user authentication system using the popular Node package, Passport.

Continue reading “DAT602 – Face Login and User Authentication with Node.js Passport”

DAT602 – Face Recognition with Azure Face API and Python

Face detection result

Having spent many hours tinkering with Amazon’s Rekognition API and making little progress, I decided to investigate the face recognition Face API provided as part of Microsoft Azure Cognitive Services (Microsoft, no date).

The API provides functionality to implement face detection (“detect one or more human faces in an image and get back face rectangles for where in the image the faces are, along with face attributes which contain machine learning-based predictions of facial features. The face attribute features available are: Age, Emotion, Gender, Pose, Smile, and Facial Hair along with 27 landmarks for each face in the image”) and face verification (“check the likelihood that two faces belong to the same person. The API will return a confidence score about how likely it is that the two faces belong to one person”).

Continue reading “DAT602 – Face Recognition with Azure Face API and Python”

DAT602 – uSense Cognitive Functionality Testing with Node-RED – Visual Recognition

Visual recognition flow

In my previous post, I documented my tests with Node-RED and IBM Watson’s  sentiment and tone analysis services. This post will look at basic face detection using the visual recognition service.

Ultimately, I hope to use visual recognition for emotion detection.  Continue reading “DAT602 – uSense Cognitive Functionality Testing with Node-RED – Visual Recognition”

DAT602 – uSense Cognitive Functionality Testing with Node-RED – Sentiment and Tone

Node-RED flow

As part of the uSense project, we are intending that the device will be able to gauge a person’s mood through the things they say, their facial features, and their social media postings. We can leverage IBM’s Cognitive Services that are provided with IBM Watson.

The relevant services include tone analysis, sentiment analysis, visual recognition, and speech to text.

Continue reading “DAT602 – uSense Cognitive Functionality Testing with Node-RED – Sentiment and Tone”

DAT501 – t3X: 3D Interactive Twitter Visualisation

Twitter visualisation
The Brief

You are asked to create and present an artwork or performance in public exhibition. Your project should explore a creative use of technology, be it digital, mechanical, biological or not yet invented. It should be a response to work and ideas which you have encountered during the module either in the presentation sessions, on the field trip, or in your own research. Continue reading “DAT501 – t3X: 3D Interactive Twitter Visualisation”

DAT 505 – Assignment Part 4 – Python Webservice APIs

The Brief: Python Webservice APIs

For the next practical exercise you must create an auto-tweet agent.

Your program should identify the most recent page viewed by your browser (by looking in either the “Current Session” or “History” file). It should then acquire the title of the page last viewed.

For example, the title of the Ebay main page is: Electronics, Cars, Fashion, Collectibles, Coupons and More | eBay.

Your program should then tweet the fact that you liked the page:
I’m really liking Electronics, Cars, Fashion, Collectibles…

You’ll get more marks if you use the History file (it’s harder !) Include a loop so that it tweets about the most recent page every hour.

Continue reading “DAT 505 – Assignment Part 4 – Python Webservice APIs”

DAT 505 – Assignment – Part 3 – Python Multimedia

The Brief – Python Multimedia:

In the next practical you must create a graphical visualisation of a textual data file (to be given out in the practical). Read in the data and use it to generate some kind of visual output.

Rather than using Pygame to create your visualisation (which is powerful, but can be tricky to install), we will be using a library called graphics.py. This can just be dropped into your folder and used (no install needed). Continue reading “DAT 505 – Assignment – Part 3 – Python Multimedia”