Carnatic Youtube Collection
-
- Posts: 44
- Joined: 10 Jan 2020, 12:37
Re: Carnatic Youtube Collection
Thanks for pointing out your focus on search. I tried it out, and indeed, search is fantastic. In particular, being able to use approximate transliterations makes searching superb! Language options is cherry on top.
I now see there are at least two top-level use cases I see to using the app:
1) Search: when you already know what you want (app is already fantastic for this!)
2) Exploring and discovering: when you are in "exploration mode," seeking to expand your horizons
I tend to use (2) a lot: usually, I want to go discover all the songs in a certain ragam, and then pick one. The app doesn't quite work for this purpose currently, which is what motivated the feedback in my post above. BTW, your website works beautifully for exploring/discovering.
I now see there are at least two top-level use cases I see to using the app:
1) Search: when you already know what you want (app is already fantastic for this!)
2) Exploring and discovering: when you are in "exploration mode," seeking to expand your horizons
I tend to use (2) a lot: usually, I want to go discover all the songs in a certain ragam, and then pick one. The app doesn't quite work for this purpose currently, which is what motivated the feedback in my post above. BTW, your website works beautifully for exploring/discovering.
-
- Posts: 44
- Joined: 10 Jan 2020, 12:37
Re: Carnatic Youtube Collection
BTW, just for my curiosity: technically, how does transliteration work so well with your website and app? How does the app recognize "gnb" as "G. N. Balasubramaniam", or "dhwijavanthi" as the correct ragam? How do videos with different spellings for the same song get indexed correctly to the same song?
-
- Posts: 44
- Joined: 10 Jan 2020, 12:37
Re: Carnatic Youtube Collection
Ah, never mind, I tried out a fuzzy search library in python, and it actually works surprisingly well with the cases above.
-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
You have fuzzy search in python : https://whoosh.readthedocs.io/en/latest/intro.html
For javascript I use: https://lucaong.github.io/minisearch/
Fuzzy search is standard part of any scripting languages.
Challenges are in transliterations of sanskritized words into tamil like: balagopala (~ palakopala) where the fuzzy search helps
Raman
For javascript I use: https://lucaong.github.io/minisearch/
Fuzzy search is standard part of any scripting languages.
Challenges are in transliterations of sanskritized words into tamil like: balagopala (~ palakopala) where the fuzzy search helps
Raman
-
- Posts: 44
- Joined: 10 Jan 2020, 12:37
Re: Carnatic Youtube Collection
Good to know. The tweaks in the latest version are very good!
-
- Posts: 16
- Joined: 08 Nov 2021, 00:58
Re: Carnatic Youtube Collection
This is not just an index of Carnatic tracks on Youtube, but likely the most comprehensive database, literally, of all Carnatic music compositions known to mankind. Great thanks on this fantastic effort, and for open sourcing it!
-
- Posts: 16
- Joined: 08 Nov 2021, 00:58
Re: Carnatic Youtube Collection
@ranjanimalavi, is it helpful to you to "reduce the noise" to submit errors? And if so, what is the best way to submit errors. To be clear, error rate is quite low and it's very usable overall.
Examples: AWPqzHrkT-A, HCJFJ4fHgIo are classified as Purvi, but they should be purvikalyani.
Examples: AWPqzHrkT-A, HCJFJ4fHgIo are classified as Purvi, but they should be purvikalyani.
-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
madChapu,
I have kept the errors within 2%, but some cases are not known to me.
both has same title:
Isai Chaaral Maharajapuram S Srinivasan Poorvi Kalyana Alapana"
though description has poorvikalyani and nowhere there is a song.
and title wins which has only poorvi.
There is a developer contact under:
https://play.google.com/store/apps/deta ... n_IN&gl=US
tree.logger.app@gmail.com
you can send a mail to above email, i will correct it.
Raman
I have kept the errors within 2%, but some cases are not known to me.
both has same title:
Isai Chaaral Maharajapuram S Srinivasan Poorvi Kalyana Alapana"
though description has poorvikalyani and nowhere there is a song.
and title wins which has only poorvi.
There is a developer contact under:
https://play.google.com/store/apps/deta ... n_IN&gl=US
tree.logger.app@gmail.com
you can send a mail to above email, i will correct it.
Raman
-
- Posts: 16
- Joined: 08 Nov 2021, 00:58
Re: Carnatic Youtube Collection
Will do, @ranjanimalavi.
I created a new web app based on your wonderful database: Ragam Radio based on your database. Will post more details in a separate thread soon. See the about page, and feel free to let me know if you'd prefer to be credited differently.
Thank you again!
I created a new web app based on your wonderful database: Ragam Radio based on your database. Will post more details in a separate thread soon. See the about page, and feel free to let me know if you'd prefer to be credited differently.
Thank you again!
-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
its fine, @MadChapu
I have created all my pages, only for the reason below.
I need to thank thousands of people who have uploaded the videos, i only aggregated it.
யான் பெற்ற இன்பம் பெறுக இவ்வையகம்
This world shall get the bliss I got!
https://shaivam.org/to-practise/when-wi ... to-see-god
Raman
I have created all my pages, only for the reason below.
I need to thank thousands of people who have uploaded the videos, i only aggregated it.
யான் பெற்ற இன்பம் பெறுக இவ்வையகம்
This world shall get the bliss I got!
https://shaivam.org/to-practise/when-wi ... to-see-god
Raman
-
- Posts: 16872
- Joined: 22 Jun 2006, 09:30
Re: Carnatic Youtube Collection
Raman,
tAn peTRa inbam ivvaiyagam peRa
vAneTTa muyanRu piRaruDan pagirgirIr!
vAzhga!
To share with the world what you savored
What tremendous efforts you have put into it!
May you flourish!
tAn peTRa inbam ivvaiyagam peRa
vAneTTa muyanRu piRaruDan pagirgirIr!
vAzhga!
To share with the world what you savored
What tremendous efforts you have put into it!
May you flourish!

-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
Since its music season,
Carnatic Youtbe Collection videos is around 1,50,000+ (26,000 chapter videos also)
Hindustani Youtbe Collection videos is around 1,35,000-
https://ramanarunachalam.github.io/Musi ... natic.html
https://ramanarunachalam.github.io/Musi ... stani.html
https://sites.google.com/site/ramanarunachalamhome
Raman
Carnatic Youtbe Collection videos is around 1,50,000+ (26,000 chapter videos also)
Hindustani Youtbe Collection videos is around 1,35,000-
https://ramanarunachalam.github.io/Musi ... natic.html
https://ramanarunachalam.github.io/Musi ... stani.html
https://sites.google.com/site/ramanarunachalamhome
Raman
-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
In my site: https://ramanarunachalam.github.io/Musi ... natic.html
I have added a feature sometime back to list the songs of a concert, if you click on the 'layers' icon if it has a song list.
I have taken some pain to collect all the list from comments of such concert videos.
Also for top older artists (ARI, SSI, GNB, MMI, LGJ, TNK, MSG etc), I have resolved many of the concerts which didn't have a list.
Raman
I have added a feature sometime back to list the songs of a concert, if you click on the 'layers' icon if it has a song list.
I have taken some pain to collect all the list from comments of such concert videos.
Also for top older artists (ARI, SSI, GNB, MMI, LGJ, TNK, MSG etc), I have resolved many of the concerts which didn't have a list.
Raman
-
- Posts: 968
- Joined: 04 Mar 2020, 20:25
Re: Carnatic Youtube Collection
Absolutely fantastic, Sir.
You have attempted a daunting task
. I am using a low cost android tablet and because of that ,the interface is a bit challenging. Limitation of screen size.
.
To create a datbase , integrating, raagas( even rare ones), artiste, keertanam, composer, video url, lyrics, and to cap it all, the exact time stamp,
In each video,..
.my pranaams in reverence to your technical expertise,
Phenomenal gui and imagination, and
Open source contribution.
As you mentioned there is also the problem of phonetic transliteration.
.
I wont be surprised , if you aim at translation even.
Nothing is beyond you.
.
May I suggest the following?
1.
Please add the rarest video of a
Concert by NCVasantha kokilam uploaded by Raju asokan.
2.
Naadabrunga and vaak team have uploaded about 25 full concerts by MSSubbulakshmi mostly in music academy, from 1955. With full songlist and time stamp information.
They can be incorporated in your project.
3.
Vidwan Kaldas has uploaded three videos , of MSS, NCV , a collection of old and rare 78 rpm records. A treasure to preserve. and propagate through your wonderful project.
4.
More concerts and songs by Musiri, Chembai, MVI, Satthur Subramanyam,
Aalatthoor can be used.
5.
Nearly a 100 records of vintage DKP have been placed in archive with full information by forumite shank.
But not in youtube format.
He may kindly be requested to upload and share with you.
Best regards.Sir
You have attempted a daunting task
. I am using a low cost android tablet and because of that ,the interface is a bit challenging. Limitation of screen size.
.
To create a datbase , integrating, raagas( even rare ones), artiste, keertanam, composer, video url, lyrics, and to cap it all, the exact time stamp,
In each video,..
.my pranaams in reverence to your technical expertise,
Phenomenal gui and imagination, and
Open source contribution.
As you mentioned there is also the problem of phonetic transliteration.
.
I wont be surprised , if you aim at translation even.
Nothing is beyond you.
.
May I suggest the following?
1.
Please add the rarest video of a
Concert by NCVasantha kokilam uploaded by Raju asokan.
2.
Naadabrunga and vaak team have uploaded about 25 full concerts by MSSubbulakshmi mostly in music academy, from 1955. With full songlist and time stamp information.
They can be incorporated in your project.
3.
Vidwan Kaldas has uploaded three videos , of MSS, NCV , a collection of old and rare 78 rpm records. A treasure to preserve. and propagate through your wonderful project.
4.
More concerts and songs by Musiri, Chembai, MVI, Satthur Subramanyam,
Aalatthoor can be used.
5.
Nearly a 100 records of vintage DKP have been placed in archive with full information by forumite shank.
But not in youtube format.
He may kindly be requested to upload and share with you.
Best regards.Sir
-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
I crawl and update youtube videos twice every week.
All youtube channels you mentioned are already there and indexed.
Now and then i miss a video, later i find it or because the artist might have been completely misspelt.
Raman
All youtube channels you mentioned are already there and indexed.
Now and then i miss a video, later i find it or because the artist might have been completely misspelt.
Raman
-
- Posts: 968
- Joined: 04 Mar 2020, 20:25
Re: Carnatic Youtube Collection
@ranjanimalavi
.
Yes Sir. Just now tried with search for ncvasanthakokilam. It is working very fine.
There are about 15 videos..unnamed as yet. Some of tnem uploaded by APKNS.
All those videos have title. I will prepare the list and post here.
Watch "N.C. Vasanthakokilam, Thanthai Thaai Kaattidaatha - A tribute to Mahatma Gandhi. Raga: Ragamalika" on YouTube
.also some nice songs with links in
Google site ncvasanthakokilam
.
..
SDhano dhaanya 78 rpm is available in youtube..a classic duet with d.k.roy.
Not captured by crawler.
https://youtu.be/uFZmJadyYhM?si=z8RAjHhJXvPAEtp9
.
Yes Sir. Just now tried with search for ncvasanthakokilam. It is working very fine.
There are about 15 videos..unnamed as yet. Some of tnem uploaded by APKNS.
All those videos have title. I will prepare the list and post here.
Watch "N.C. Vasanthakokilam, Thanthai Thaai Kaattidaatha - A tribute to Mahatma Gandhi. Raga: Ragamalika" on YouTube
.also some nice songs with links in
Google site ncvasanthakokilam
.
..
SDhano dhaanya 78 rpm is available in youtube..a classic duet with d.k.roy.
Not captured by crawler.
https://youtu.be/uFZmJadyYhM?si=z8RAjHhJXvPAEtp9
-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
Thank you @sam
Above two songs are there now.
I checked APKoil N Sapthagireesan, mostly they are movie songs
Raman
Above two songs are there now.
I checked APKoil N Sapthagireesan, mostly they are movie songs
Raman
-
- Posts: 349
- Joined: 17 Feb 2007, 06:15
Re: Carnatic Youtube Collection
In my site: https://ramanarunachalam.github.io/Musi ... natic.html
I have added a feature to list the songs of a concert, if you click on the 'layers' icon if it has a song list.
I have also added earmark icon to indicate if its a direct play or its a chapter, when it doesn't have layer icon.
Also for top artists, I have resolved many of the concerts which didn't have a list in comments section.
Now I have exposed the list for browsing and searching, it has (!) exclamation instead of play button as its
not playable directly like the one part of chapters. You have to manually find out from the concert list.
Also the concerts which are same (have same songs) are grouped together like songs, ordered (descending) by their views.
Raman
I have added a feature to list the songs of a concert, if you click on the 'layers' icon if it has a song list.
I have also added earmark icon to indicate if its a direct play or its a chapter, when it doesn't have layer icon.
Also for top artists, I have resolved many of the concerts which didn't have a list in comments section.
Now I have exposed the list for browsing and searching, it has (!) exclamation instead of play button as its
not playable directly like the one part of chapters. You have to manually find out from the concert list.
Also the concerts which are same (have same songs) are grouped together like songs, ordered (descending) by their views.
Raman