Carnatic Youtube Collection

Miscellaneous topics on Carnatic music
Sath
Posts: 44
Joined: 10 Jan 2020, 12:37

Re: Carnatic Youtube Collection

Post by Sath »

Thanks for pointing out your focus on search. I tried it out, and indeed, search is fantastic. In particular, being able to use approximate transliterations makes searching superb! Language options is cherry on top.

I now see there are at least two top-level use cases I see to using the app:
1) Search: when you already know what you want (app is already fantastic for this!)
2) Exploring and discovering: when you are in "exploration mode," seeking to expand your horizons

I tend to use (2) a lot: usually, I want to go discover all the songs in a certain ragam, and then pick one. The app doesn't quite work for this purpose currently, which is what motivated the feedback in my post above. BTW, your website works beautifully for exploring/discovering.

Sath
Posts: 44
Joined: 10 Jan 2020, 12:37

Re: Carnatic Youtube Collection

Post by Sath »

BTW, just for my curiosity: technically, how does transliteration work so well with your website and app? How does the app recognize "gnb" as "G. N. Balasubramaniam", or "dhwijavanthi" as the correct ragam? How do videos with different spellings for the same song get indexed correctly to the same song?

Sath
Posts: 44
Joined: 10 Jan 2020, 12:37

Re: Carnatic Youtube Collection

Post by Sath »

Ah, never mind, I tried out a fuzzy search library in python, and it actually works surprisingly well with the cases above.

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

You have fuzzy search in python : https://whoosh.readthedocs.io/en/latest/intro.html
For javascript I use: https://lucaong.github.io/minisearch/
Fuzzy search is standard part of any scripting languages.

Challenges are in transliterations of sanskritized words into tamil like: balagopala (~ palakopala) where the fuzzy search helps

Raman

Sath
Posts: 44
Joined: 10 Jan 2020, 12:37

Re: Carnatic Youtube Collection

Post by Sath »

Good to know. The tweaks in the latest version are very good!

MadChapu
Posts: 16
Joined: 08 Nov 2021, 00:58

Re: Carnatic Youtube Collection

Post by MadChapu »

This is not just an index of Carnatic tracks on Youtube, but likely the most comprehensive database, literally, of all Carnatic music compositions known to mankind. Great thanks on this fantastic effort, and for open sourcing it!

MadChapu
Posts: 16
Joined: 08 Nov 2021, 00:58

Re: Carnatic Youtube Collection

Post by MadChapu »

@ranjanimalavi, is it helpful to you to "reduce the noise" to submit errors? And if so, what is the best way to submit errors. To be clear, error rate is quite low and it's very usable overall.

Examples: AWPqzHrkT-A, HCJFJ4fHgIo are classified as Purvi, but they should be purvikalyani.

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

madChapu,

I have kept the errors within 2%, but some cases are not known to me.

both has same title:
Isai Chaaral Maharajapuram S Srinivasan Poorvi Kalyana Alapana"
though description has poorvikalyani and nowhere there is a song.
and title wins which has only poorvi.

There is a developer contact under:
https://play.google.com/store/apps/deta ... n_IN&gl=US
tree.logger.app@gmail.com

you can send a mail to above email, i will correct it.

Raman

MadChapu
Posts: 16
Joined: 08 Nov 2021, 00:58

Re: Carnatic Youtube Collection

Post by MadChapu »

Will do, @ranjanimalavi.

I created a new web app based on your wonderful database: Ragam Radio based on your database. Will post more details in a separate thread soon. See the about page, and feel free to let me know if you'd prefer to be credited differently.

Thank you again!

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

its fine, @MadChapu

I have created all my pages, only for the reason below.
I need to thank thousands of people who have uploaded the videos, i only aggregated it.

யான் பெற்ற இன்பம் பெறுக இவ்வையகம்
This world shall get the bliss I got!

https://shaivam.org/to-practise/when-wi ... to-see-god

Raman

arasi
Posts: 16872
Joined: 22 Jun 2006, 09:30

Re: Carnatic Youtube Collection

Post by arasi »

Raman,
tAn peTRa inbam ivvaiyagam peRa
vAneTTa muyanRu piRaruDan pagirgirIr!

vAzhga!

To share with the world what you savored
What tremendous efforts you have put into it!

May you flourish! :)

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

Since its music season,

Carnatic Youtbe Collection videos is around 1,50,000+ (26,000 chapter videos also)
Hindustani Youtbe Collection videos is around 1,35,000-

https://ramanarunachalam.github.io/Musi ... natic.html
https://ramanarunachalam.github.io/Musi ... stani.html
https://sites.google.com/site/ramanarunachalamhome

Raman

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

In my site: https://ramanarunachalam.github.io/Musi ... natic.html

I have added a feature sometime back to list the songs of a concert, if you click on the 'layers' icon if it has a song list.
I have taken some pain to collect all the list from comments of such concert videos.
Also for top older artists (ARI, SSI, GNB, MMI, LGJ, TNK, MSG etc), I have resolved many of the concerts which didn't have a list.

Raman

sam
Posts: 968
Joined: 04 Mar 2020, 20:25

Re: Carnatic Youtube Collection

Post by sam »

Absolutely fantastic, Sir.
You have attempted a daunting task
. I am using a low cost android tablet and because of that ,the interface is a bit challenging. Limitation of screen size.
.
To create a datbase , integrating, raagas( even rare ones), artiste, keertanam, composer, video url, lyrics, and to cap it all, the exact time stamp,
In each video,..
.my pranaams in reverence to your technical expertise,
Phenomenal gui and imagination, and
Open source contribution.
As you mentioned there is also the problem of phonetic transliteration.
.
I wont be surprised , if you aim at translation even.
Nothing is beyond you.
.
May I suggest the following?
1.
Please add the rarest video of a
Concert by NCVasantha kokilam uploaded by Raju asokan.
2.
Naadabrunga and vaak team have uploaded about 25 full concerts by MSSubbulakshmi mostly in music academy, from 1955. With full songlist and time stamp information.
They can be incorporated in your project.
3.
Vidwan Kaldas has uploaded three videos , of MSS, NCV , a collection of old and rare 78 rpm records. A treasure to preserve. and propagate through your wonderful project.
4.
More concerts and songs by Musiri, Chembai, MVI, Satthur Subramanyam,
Aalatthoor can be used.
5.
Nearly a 100 records of vintage DKP have been placed in archive with full information by forumite shank.
But not in youtube format.
He may kindly be requested to upload and share with you.

Best regards.Sir

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

I crawl and update youtube videos twice every week.
All youtube channels you mentioned are already there and indexed.
Now and then i miss a video, later i find it or because the artist might have been completely misspelt.

Raman

sam
Posts: 968
Joined: 04 Mar 2020, 20:25

Re: Carnatic Youtube Collection

Post by sam »

@ranjanimalavi
.
Yes Sir. Just now tried with search for ncvasanthakokilam. It is working very fine.
There are about 15 videos..unnamed as yet. Some of tnem uploaded by APKNS.
All those videos have title. I will prepare the list and post here.

Watch "N.C. Vasanthakokilam, Thanthai Thaai Kaattidaatha - A tribute to Mahatma Gandhi. Raga: Ragamalika" on YouTube
.also some nice songs with links in
Google site ncvasanthakokilam
.
..
SDhano dhaanya 78 rpm is available in youtube..a classic duet with d.k.roy.
Not captured by crawler.

https://youtu.be/uFZmJadyYhM?si=z8RAjHhJXvPAEtp9

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

Thank you @sam

Above two songs are there now.
I checked APKoil N Sapthagireesan, mostly they are movie songs

Raman

ranjanimalavi
Posts: 349
Joined: 17 Feb 2007, 06:15

Re: Carnatic Youtube Collection

Post by ranjanimalavi »

In my site: https://ramanarunachalam.github.io/Musi ... natic.html

I have added a feature to list the songs of a concert, if you click on the 'layers' icon if it has a song list.
I have also added earmark icon to indicate if its a direct play or its a chapter, when it doesn't have layer icon.
Also for top artists, I have resolved many of the concerts which didn't have a list in comments section.
Now I have exposed the list for browsing and searching, it has (!) exclamation instead of play button as its
not playable directly like the one part of chapters. You have to manually find out from the concert list.

Also the concerts which are same (have same songs) are grouped together like songs, ordered (descending) by their views.

Raman

Post Reply